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INTRODUCTION 


In  the  past,  exploitation  of  imagery  was  typically  the  domain  of  photo  interpreters  (PI).  PFs  would 
pore  over  rolls  and  rolls  of  film  on  light  tables  using  magnification  and  other  techniques  to  extract 
meaningful  information  from  these  images.  This  process  came  to  be  known  as  imagery  exploitation. 
In  today’s  world  of  ever-increasing  computing  power,  this  process  is  performed  more  and  more  in  the 
digital  domain  -  and  will  be  performed  exclusively  in  the  digital  domain  in  the  future. 

Computers  allow  a  PI  (now  more  generally  known  as  an  Imagery  Analyst  or  lA)  to  employ  an 
extraordinary  number  of  image  manipulation  techniques  to  exploit  imagery.  Recently,  there  has  also 
been  an  increasing  proliferation  of  commercial  products  that  perform  these  types  of  functions.  Some 
of  these  commercial  products  are  legacy  products  from  government  or  Department  of  Defense 
(DOD)-sponsored  efforts  to  develop  digital  imagery  exploitation  capabilities,  while  other  products 
are  aimed  at  more  commercial  applications.  This  disparate  set  of  products  creates  interface 
standardization  problems  for  the  Air  Force. 

The  Aeronautical  System  Center’s  Reconnaissance  System  Program  Office  (ASC/RAP)  was 
interested  in  providing  the  best  possible  set  of  user  interface  requirements  for  all  imagery  / 
intelligence  analysis  workstations  or  Electronic  Light  Table  (ELT)  systems.  ASC/RA  consulted  with 
AFRL/HEC  to  determine  which  ELT  systems  were  being  used,  which  system  user  interfaces  were 
most  effective  for  imagery  exploitation,  and  how  this  information  could  be  integrated  into  a  standard 
user  interface  document  for  this  class  of  workstations. 

This  document  describes  the  approach  and  method  employed  in  conducting  an  Imagery  Analyst  and 
Intelligence  Analyst  Workstation  Interface  analysis,  and  documents  the  results  and  recommendations 
from  this  analysis  -  including  a  user-interface  requirements  document  for  imagery  analysis 
workstations.  The  analysis  focus  was  task-based  and  concentrated  on  the  imagery  exploitation 
functions  performed  by  Imagery  Analysts,  as  well  as  similar  imagery-related  activities  of  intelligence 
analysts. 

Although  the  tasking  of  an  lA  is  somewhat  more  wide-ranging  than  that  depicted  in  this  report,  it  was 
determined  early  in  the  project  that  the  effort  would  be  most  effective  if  the  approach  focused  on 
basic  exploitation  activities  as  opposed  to  other  more  peripheral  tasks  an  lA  may  be  called  on  to 
perform.  Therefore,  only  those  activities  that  directly  support  image  exploitation  were  considered  for 
this  analysis. 


METHOD 

First,  an  initial  functional  decomposition  was  created  from  available  literature  describing  lA  tasks 
such  as  the  lA  training  standards  shown  in  Appendix  A.  Various  techniques  were  then  used  to 
organize  this  information  from  the  decomposition  and  literature  to  provide  a  basis  for  interviews  with 
in-house  Subject  Matter  Experts  (SME).  AFRL’s  Timeline  Management  Tool  (TMT),  a  user- 
centered  design  tool,  was  used  as  the  initial  data  repository  for  the  task  decomposition  data.  The 
interviews  --  initiated  to  better  understand  the  nature  of  imagery  exploitation  and  the  role  of  the 
imagery  analyst  in  this  process  -  concentrated  on  the  cognitive  and  perceptual  requirements  of  image 
exploitation,  and  attempted  to  establish  the  hypothesis-testing  nature  of  imagery  exploitation.  After 
several  iterations  of  this  process,  a  representation  of  lA  cognitive  task  behavior  was  established. 
Several  Cognitive  Task  Analysis  (CTA)-like  methods  were  leveraged  during  this  process.  While 
these  included  some  cognitive  mapping  techniques  similar  to  those  pioneered  by  Zaff,  McNeese,  and 
Snyder  (1993),  the  most  important  understanding  provided  by  CTA  was  the  representation  of  lA  task 
behavior  in  an  abstraction  hierarchy  similar  to  that  originated  by  Rasmussen  (1986).  A  depiction  of 
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this  hierarchy  is  found  in  Figure  1.  One  of  the  key  benefits  of  using  a  cognitive-based  approach  for 
this  project  (as  opposed  to  a  more  traditional  behavioral  approach)  was  that  it  provided  the 
researchers  with  insight  into  the  goal-oriented  nature  of  image  exploitation.  It  also  provided  more 
insight  into  the  importance  of  the  supporting  functions  of  image  exploitation  (functions  that  we 
classified  as  orientation  or  reporting)  that  do  not  traditionally  receive  as  much  attention  as  the  ‘core’ 
exploitation  functions  (those  dedicated  to  directly  extracting  information  from  a  scene).  Finally,  this 
cognitive-based  approach  provided  some  insight  into  the  nature  of  the  more  abstract  information 
manipulation  activities  associated  with  image  exploitation.  An  example  of  these  activities  may  be 
found  in  the  subtle  distinction  made  between  a  group  of  targets  displayed  in  an  image.  When  the 
goal  of  the  exploitation  of  this  image  is  to  simply  report  each  target  within  this  group,  the  group  may 
be  identified  as  just  some  enemy  tanks  or  armored  vehicles.  However,  when  the  goal  shifts  to 
evaluation  of  the  threat  of  this  group  of  vehicles,  the  identification  may  change  to  an  enemy  tank 
column  that  poses  a  hazard  to  a  friendly  unit.  The  presence  of  contextual  information  found  in  the 
image  scene  that  allows  this  kind  of  distinction  may  be  lost  when  the  goal  of  the  task  is  not  clear. 

Decomposition  of  lA  performance  began  with  definition  of  the  overall  goals  of  the  lA.  Essentially, 
the  lA’s  job  is  to  extract  information  from  imagery  to  answer  questions  posed  by  intelligence  staff. 
The  questions  can  vary  significantly  in  terms  of  scope  and  specificity  (e.g.,  “Is  there  anything  of 
military  significance  in  this  image?”  versus  “How  many  and  what  types  of  armored  vehicles  are  in 
this  scene?”  versus  “Confirm  or  refute  the  following  scenario”  versus  “What  is  going  on  in  this 
scene?”).  In  all  cases,  however,  the  process  of  the  lA’s  job  is  the  same  —  questions  to  be  answered 
must  be  translated  into  information  elements  to  be  obtained  from  imagery,  those  information 
elements  must  be  translated  into  objects  and  attributes  that  can  be  found  in  a  scene,  imagery  must  be 
evaluated  to  find  and  assess  the  objects  sought,  and  a  report  must  be  prepared  that  applies  the  results 
of  the  imagery  evaluation  to  answer  the  original  questions. 

As  with  much  of  human  performance,  speed  and  accuracy  are  important  attributes  of  lA 
performance.  Speed  relates  directly  to  productivity.  Faster  image  exploitation  times  lead  to  greater 
imagery  throughput.  Greater  accuracy  in  finding,  identifying,  and  assessing  objects  in  imagery  leads 
to  more  effective  answers  to  questions. 

Figure  1  depicts  the  three  main  processes  or  sub-goals  involved  in  image  exploitation.  Orientation  is 
the  process  of  understanding  the  requirements  of  the  task  (translating  the  question  or  questions  into 
objects  that  must  be  sought  in  the  imagery),  identifying,  acquiring,  and  organizing  supplemental 
resources,  and  becoming  acquainted  with  the  characteristics  of  the  imagery  that  may  provide 
contextual  and  /  or  cultural  information.  This  process  is  also  known  as  getting  situated.  Orientation 
includes  reviewing  the  tasking,  gathering  relevant  resources  (resources  relevant  to  answering  the 
explicit  and  implicit  questions  from  the  tasking),  and  organizing  those  resources  in  ways  that 
facilitate  the  information  extraction  function. 

Information  Extraction  is  the  process  of  finding  objects  in  the  imagery,  and  coming  to  conclusions 
about  the  states  or  intentions  of  those  objects.  It  is  important  to  note  that  the  term  ‘object’  may  refer 
to  groups  of  detectable  entities  in  an  image  as  well  as  individual  ones,  and  may  also  represent 
abstract  entities  as  well  as  concrete  ones.  Information  extraction  involves  the  assessment  of  the 
context,  patterns,  and  relationships  among  objects.  This  process  can  be  considered  to  contain  the 
‘core’  exploitation  activities  —  those  of  detection,  classification,  and  identification.  That  is, 
information  extraction  includes  object  detection,  object  interpretation,  and  object  analysis. 
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Abstraction  Hierarchy 

Fiinrtinn^l  Fundamentallnteliigence  Activity 

^ _  ^  (Answer  questions  in  the  tasking) 


(ELT  system  features  U  \ 

represent  something  like  (e.g..  idem^  <^>tect  and  Is  impScation) 

the  level  of  physical  form) 

Figure  1.  The  Imagery  Analyst  task  hierarchy  mapped  to  Rasmussen’s  (1986)  Abstraction  Hierarchy. 


Reporting  is  the  process  of  compiling  and  disseminating  conclusions  drawn  from  the  imagery. 
Reporting  includes  imagery  product  creation,  text  product  creation,  and  report  dissemination. 

An  example  of  how  an  lA  might  begin  to  exploit  imagery  begins  with  the  lA  opening  the  task  order 
file.  This  action  falls  under  the  physical  function  of  ‘access  an  exploitation  assignment’  which  falls 
under  the  generalized  function  of  ‘review  tasking’  and  the  abstract  function  of  ‘orientation’  in  the 
hierarchy  (see  Figure  1).  The  task  behavior  then  progresses  to  reviewing  the  task  order  to  determine 
the  questions  that  the  LA  must  answer  from  the  imagery.  This  action  falls  under  the  physical  function 
of  ‘study  exploitation  assignment’,  and  also  under  the  ‘review  tasking’  generalized  function.  The  lA 
may  then  open  imagery  files  pertinent  to  the  task,  which  falls  under  the  physical  function  of  ‘access 
primary  imagery’  and  the  generalized  function  of  ‘gather  relevant  resources’.  Then,  the  lA  may 
mosaic  images  (supporting  the  physical  function  of  ‘arrange  imagery’  and  the  generalized  function  of 
‘organize  resources’)  to  begin  understanding  the  relevant  relationships  between  the  imagery  and  the 
questions  being  asked.  All  of  these  actions  are  considered  to  support  the  abstract  function  of 
‘orientation’,  but  ~  based  on  the  results  of  the  orientation  activities  -  the  LA  would  proceed  to 
information  extraction  activities  and  then,  finally,  to  reporting  activities.  Any  or  all  of  these 
activities  may  then  be  repeated  until  the  question  or  questions  in  the  task  order  have  been  answered 
and  appropriately  documented. 

Figure  1  also  demonstrates  how  Rasmussen’s  (1986)  abstraction  hierarchy  maps  to  the  lA  task 
hierarchy.  This  abstraction  hierarchy  is  a  means-ends  representation  of  the  functional  properties  of  a 
technical  system.  The  top  of  the  hierarchy  (the  ends  level)  represents  the  purposes  or  goals  for  which 
the  system  was  created.  The  bottom  of  the  hierarchy  (the  means  level)  represents  the  physical 
manifestation  of  system  goal  or  purpose.  Rasmussen  (1986)  states  that,  “Such  a  hierarchy  describes 
bottom-up  what  components  and  functions  can  be  used  for,  how  they  may  serve  higher  level 
purposes,  and  top-down,  how  purposes  can  be  implemented  by  functions  and  components”  (p.  14). 

In  Rasmussen’s  (1986)  abstraction  hierarchy,  the  lowest  level  is  the  level  of  physical  form.  This 
level  is  the  most  concrete  and  represents  the  system  in  physical  appearance  and  configuration.  An 
example  of  this  level  in  the  imagery  exploitation  case  would  be  a  particular  image  contrast 
adjustment  tool.  The  next  level  up  is  that  of  physical  function.  This  level  represents  the  physical 
processes  of  the  system  such  as  -  in  the  case  of  imagery  exploitation  ~  object  mensuration.  The  next 
level  is  that  of  generalized  function.  This  level  represents  those  system  functional  relationships  that 
are  generally  independent  of  physical  manifestation.  In  this  case,  object  detection  is  an  example. 

The  next  level  is  that  of  abstract  function.  This  level  represents  the  overall  organizing  principle 
behind  the  system.  An  example  in  this  case  is  information  extraction.  At  the  top  of  the  hierarchy  lies 
the  level  of  functional  purpose,  which  ~  as  mentioned  earlier  -  is  the  intended  purpose  of  the  system. 
In  this  case,  it  is  to  answer  the  questions  in  the  exploitation  tasking.  In  terms  of  the  imagery 
exploitation  system,  the  three  main  processes  described  here  represent  abstract  functions  --  while 
actual  software  or  hardware  features  exhibited  by  ELT  systems  represent  the  level  of  physical  form. 

After  the  cognitive  processes  involved  with  image  exploitation  had  been  established,  it  became 
important  to  understand  ELT  system  capabilities  -  and  how  these  capabilities  support  imagery 
exploitation.  Four  currently  available,  in-use  ELT  systems  were  selected  for  a  feature  cataloguing 
effort.  The  ELT  packages  that  were  examined  were  VITec  ELT,  Paragon  ELT  2500,  Matrix,  and 
Digital  Imagery  Exploitation  Production  System  (DIEPS).  All  of  these  were  software  packages  that 
run  on  UNIX-based  X-Windows  workstations.  Due  to  limitations  in  time  and  availability,  all¬ 
possible  ELT  systems  were  not  assessed.  However,  the  four  systems  that  were  chosen  adequately 
represent  the  basic  functionality  that  this  project  sought  to  capture.  The  feature  compilation  and 
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Figure  2.  How  the  feature  categories  correspond  to  the  hierarchy. 


review  distilled  all  of  these  ELT  features  down  to  1 10.  These  1 10  features  formed  the  basis  for  the 
subjective  surveys  described  later  in  this  document 

The  ELT  system  feature  compilation  effort  sought  to  organize  workstation  capabilities  in  terms  of 
functions  that  supported  the  process  of  imagery  exploitation.  Once  the  set  of  possible  ELT  features 
had  been  specified,  they  were  integrated  into  the  lA  hierarchy  under  the  nodes  that  best  categorized 
them.  The  features  were  hardware  or  software  instantiations  of  physical  functions  (not  unlike  the 
level  of  physical  form)  and  so  they  represented  a  linking  of  the  ELT  systems  to  the  lA  hierarchy. 
Seven  categories  of  features  were  later  defined  to  facilitate  data  analysis  and  interpretation.  These 
categories  are  shown  in  Figure  2. 

Essentially,  features  were  categorized  by  their  respective  general  functions  --  except  that  the  Detect 
Object’  and  ‘Interpret  Object’  categories  were  combined,  as  were  the  Create  Imagery  Product  and 
‘Create  Text  Product’  categories.  These  categories  were  combined  to  simplify  data  analysis.  Also, 
note  that  no  catalogued  features  supported  the  ‘Analyze  Object’  category. 

Data  Collection  Method 

Data  collection  was  a  bilateral  approach.  The  first  half  centered  on  an  actual  exploitation  exercise, 
and  the  second  half  was  a  subjective  survey.  The  analysts  were  asked  to  perform  the  exploitation 
exercise  to  the  best  of  their  abilities  using  an  ELT  system  (one  or  several)  with  which  they  were  most 
familiar  and  experienced.  Then  each  analyst  separately  filled  out  each  section  of  the  survey. 

Exploitation  Exercise 

The  main  purpose  of  the  exploitation  exercise  was  to  provide  a  situated  context  for  consideration  and 
discussion  of  ELT  system  features  and  capabilities.  The  second  purpose  was  the  opportunity  to 
observe  analysts’  problem-solving  behavior  and  to  allow  the  opportunity  to  verify  the  accuracy  of  the 
LA  hierarchy.  The  exploitation  exercise  was  created  by  SAIC  SMEs  and  staff,  and  was  validated  by 
members  of  the  National  Air  Intelligence  Center  (NAIC).  The  exploitation  exercise  was  built  around 
a  fictional  scenario  that  required  analysts  to  review  accompanying  Synthetic  Aperture  Radar  (SAR) 
imagery  and  draw  conclusions  about  certain  military  activity.  The  material  developed  to  support  the 
scenario  included  background  information  provided  to  lAs  in  a  paper-based  task  order  package  and 
22  National  Imagery  Transmission  Format  (NITF)  images  (1 1  reference  images  and  1 1  mission 
images).  Both  reference  imagery  and  mission  imagery  were  constructed  to  provide  a  story  coherent 
with  the  scenario.  The  image  files  were  provided  in  NITF  2.0  format  to  facilitate  exploitation  on  all 
the  ELT  systems  of  interest  in  this  study,  since  all  the  software  packages  supported  this  file  format. 

The  images  used  in  the  scenario  were  constructed  by  combining  separate  Synthetic  Aperture  Radar 
(SAR)  clutter  and  target  images  to  produce  realistic  SAR  imagery.  The  separate  raw  SAR  clutter  and 
target  images  were  collected  near  Huntsville,  AL  in  September  1995  as  part  of  Moving  and 
Stationary  Target  Acquisition  and  Recognition  (MSTAR)  Data  Collection  #1  conducted  by  Sandia 
National  Laboratory  (SNL)  using  a  SAR  sensor  platform  (see  Appendix  B).  All  of  the  images  had  a 
one-foot  resolution  and  were  collected  at  a  15-degree  depression  angle.  The  clutter  images  were 
collected  in  a  stripmap  mode,  while  the  target  images  were  collected  in  a  spotlight  mode.  Building 
the  scenario  began  with  the  examination  of  the  MSTAR  clutter  imagery  to  identify  the  geo-political 
context  for  the  exercise.  Once  suitable  cultural  features  were  identified  by  the  SME,  a  plausible 
story  was  built  around  these  features.  Locations  and  orientations  for  armored  vehicles  in  the  clutter 
images  were  specified  by  the  SME  to  support  the  story.  Appropriate  MSTAR  target  chips  were  then 
selected  according  to  the  specifications  mentioned  previously.  SAIC  proprietary  and  commercial 
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software  packages  were  used  to  place  the  selected  SAR  target  chips  within  the  appropriate  clutter 
images. 

The  scenario  was  designed  to  exercise  all  aspects  of  the  exploitation  process  including  orientation, 
information  extraction,  and  reporting.  This  coherent  and  compelling  scenario  provided  a  high  degree 
of  realism  to  the  analysts  and  required  them  to  exercise  their  detection,  interpretation,  and  analysis 
skills.  It  was  expected  that  the  analysts  would  have  to  read  the  background  information  about  the 
scenario,  and  view  and  mosaic  the  accompanying  imagery  to  get  oriented  to  the  problem  (orientation 
activity).  They  would  then  have  to  detect,  classify,  and  identify  vehicles  and  building  structures 
found  in  the  imagery  and  come  to  certain  conclusions  about  the  vehicles  or  groups  of  vehicles  based 
on  their  experience  and  the  scenario’s  background  information  (information  extraction  activity). 
Finally,  they  would  have  to  produce  imagery  and  text  products  that  would  illustrate  the  justifications 
for  their  conclusions  in  accordance  with  the  directions  in  the  task  order  (reporting  activity).  A  copy 
of  the  task  order  package  and  some  examples  of  the  accompanying  imagery  can  be  found  in 
Appendix  C. 

Subjective  Survey 

The  subjective  survey  incorporated  two  factors  {utility  and  usability)  for  rating  purposes,  plus  a 
comment  solicitation  section.  An  example  of  the  survey  may  be  found  in  Appendix  D. 

The  utility  portion  of  the  survey  was  aimed  at  evaluating  the  usefulness  of  each  of  the  110 
representative  features  to  the  exploitation  process.  Utility  was  rated  on  a  one-to-five  scale,  where 
one  was  useless  to  image  exploitation,  two  was  slightly  useful,  three  was  useful,  four  was  very 
useful,  and  five  was  essential. 

The  usability  portion  of  the  survey  was  aimed  at  evaluating  how  well  certain  ELT  systems  had 
implemented  these  features,  i.e.,  how  usable  was  a  particular  feature  as  implemented  on  a  particular 
ELT  system.  Usability  was  also  rated  on  a  one-to-five  scale,  where  one  represented  extremely  poor 
usability,  two  was  poor,  three  was  fair,  four  was  good,  and  five  represented  excellent  usability. 
Usability  ratings  were  to  be  provided  by  each  analyst  for  as  many  features  of  as  many  ELT  systems 
with  which  the  analyst  had  experience.  Seven  different  ELT  systems  were  rated  on  usability  for  at 
least  some  features.  The  seven  were  VITec  ELT,  Matrix,  DIEPS,  ERDAS  Imagine,  the  Combat 
Airborne  Reconnaissance  System’s  (CARS)  Primary  Mission  Equipment  (PME),  Harris 
Corporation’s  Multi-Image  Exploitation  Tool  (MET),  and  the  Imagery  Data  Exploitation  System 
(IDEX).  This  list  represents  most  of  the  ELT  and  exploitation  systems  currently  being  used  within 
the  DOD. 


Subjects 

Data  were  collected  from  various  user  groups.  They  were  the  30*  Intelligence  Squadron  (IS)  at 
Langley  AFB,  VA,  the  480*  Imagery  Group  (IG)  also  based  at  Langley  AFB,  and  the  National  Air 
Intelligence  Center  (NAIC)  based  at  Wright-Patterson  AFB,  OH. 

The  30th  IS  representing  Air  Combat  Command  (ACC)  provided  four  subjects.  Their  experience 
levels  were  6,  2‘/2,  2,  and  1  years,  respectively.  This  group  also  represented  the  first  phase 
exploitation  community,  as  most  of  their  tasking  is  tactical  exploitation. 

The  480th  Intelligence  Group  (IG)  representing  the  Air  Intelligence  Agency  (AIA)  provided  two 
subjects.  Their  experience  levels  were  1  and  7‘/2  years,  respectively.  This  group  represented  the 
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second  phase  exploitation  community,  as  most  of  their  tasking  was  supplemental  reporting  and  the 
creation  of  imagery  products  for  further  analysis. 

Finally,  NAIC  provided  four  subjects  who  validated  the  plausibility  of  the  scenario,  realism  of  the 
imagery,  and  provided  comments  on  the  ELT  system  features.  This  group  represented  the  third  phase 
exploitation  community,  as  most  of  their  tasking  was  imagery  exploitation  with  the  purpose  of 
gathering  Science  and  Technology  (S&T)  intelligence. 

RESULTS 

General  Observations 

The  first  general  observation  from  data  collection  sessions  was  that  the  imagery  analysts  considered 
the  exploitation  scenario  and  the  accompanying  imagery  as  very  realistic.  Almost  all  of  the  subjects 
believed  the  imagery  to  be  real  and  most  believed  that  the  scenario  had  actually  taken  place.  This 
fortuitously  lent  considerable  credibility  to  the  entire  effort. 

Every  subject  shifted  goal  states  while  exploiting  the  imagery.  That  is,  every  analyst  began  the 
exercise  with  orientation  activities,  moved  to  information  extraction  and  reporting,  and  fluctuated 
between  the  three  goal  states  several  times  during  the  course  of  the  exercise.  As  subjects  continued 
to  work  the  exploitation  problem,  they  alternately  performed  orientation,  information  extraction,  and 
reporting  activities.  This  task  behavior  was  not  unexpected  based  on  the  lA  hierarchy-predicted  task 
flow  outlined  earlier. 

Orientation  activities  consumed  significant  amounts  of  time  when  multiple  /  mosaiced  images  were 
involved.  This  result  was  also  somewhat  expected  given  the  lack  of  ‘automatic’  mosaicing  tools  by 
all  of  the  ELT  systems  used  in  the  exploitation  exercise. 

Finally,  analysts  at  the  480th  IG  used  multiple  tools  to  perform  the  exercise.  During  certain  periods 
in  the  exercise,  especially  during  shifts  in  goal  states,  these  analysts  chose  to  use  different  ELT 
systems  to  perform  different  functions.  These  analysts  had  the  luxury  of  being  able  to  choose  from 
any  of  the  systems  evaluated  in  this  study  at  any  time,  but  it  illustrates  that  none  of  the  existing 
systems  may  be  best  suited  for  performing  all  aspects  of  the  exploitation  task. 

Data  Analysis 


Results  of  lA  Hierarchy  Verification 

In  order  to  verify  that  the  lA  hierarchy  was  indeed  representative  of  the  way  analysts  exploit  imagery, 
we  tracked  lA  progression  through  the  exploitation  exercise  in  the  context  of  the  hierarchy.  For  each 
lA,  records  were  kept  on  the  sequence  of  activities  performed  as  he  or  she  progressed  through  the 
tasking.  Task  behavior  observations  were  associated  with  corresponding  functions  in  the  lA 
hierarchy  ~  from  the  abstract  function  level  down  to  the  physical  function  level  (see  again  Figure  1). 
After  examining  all  of  the  hierarchy  sequences,  a  composite  sequence  was  built  that  represents  the 
vast  majority  of  task  behavior.  This  composite  sequence  is  shown  in  Figure  3. 
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Figure  3.  A  composite  lA  cognitive  behavior  map. 

Each  physical  function  was  assigned  an  arbitrary  value  within  that  physical  function’s  abstract 
function  and  plotted  in  sequence  of  performance.  This  plot  shows  that  lAs  do  indeed  shift  goal  states 
and  that  progression  through  exploitation  is  not  linear  and  procedural,  but  instead  is  goal  driven  and 
dynamic.  It  also  suggests  that  context  is  important  for  driving  some  of  the  shifts  in  the  analysts’  goal 
states.  Specifically,  context  refers  to  the  LA’s  behavior  relative  to  the  question  or  questions  being 
posed  and  the  nature  of  the  imagery.  In  this  case,  for  example,  it  is  not  enough  for  the  lA  to  simply 
identify  or  classify  vehicles  in  the  radar  imagery.  The  LA  must  also  determine  --  based  on  the 
scenario  claim  that  no  Soviet  tanks  have  left  garrison  --  whether  or  not  the  Russians  are  telling  the 
truth.  This  claim  needs  to  be  tested,  but  that  requires  far  more  confidence  in  vehicle  identification 
than  it  may  otherwise.  Also,  the  fact  that  the  lAs  examine  SAR  imagery  carries  certain  implications 
for  their  expectations  regarding  what  one  may  see  in  SAR  imagery  that  is  distinctly  different  from 
visual  imagery.  These  factors  affect  how  the  exploitation  process  is  carried  out. 

Figure  4  is  an  actual  imagery  product  from  the  exploitation  exercise.  The  top  and  bottom  images  are 
both  mosaics  of  three  separate  images  each.  The  top  mosaic  depicts  a  certain  area  as  it  was  on 
1  August,  and  the  bottom  mosaic  depicts  essentially  the  exact  same  area  as  it  was  on  10  August.  This 
demonstrates  that  the  analyst  was  able  to  establish  the  spatial  relationships  between  separate  images 
and  the  temporal  relationships  between  the  mosaics.  The  annotations  in  the  images  also  demonstrate 
object  detection  activity  (which  is  evidenced  by  the  annotations  themselves),  object  interpretation 
activity  (which  can  be  seen  by  the  annotations  that  identify  certain  objects  as  certain  vehicles,  e.g., 
“Probable  BTR-70’s”),  and  analysis  activity  (which  can  be  seen  when  objects  in  each  scene  are 
identified,  not  based  solely  on  perceptual  characteristics,  but  through  the  integration  of  information 
only  available  in  the  prior  reporting  package  in  Appendix  C).  All  of  this  evidence  supports  the  idea 
that  the  exploitation  scenario  was  successful  in  that  it  forced  analysts  to  exercise  all  aspects  of 
exploitation  activity. 
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Figure  4.  Example  imagery  product  from  exploitation  exercise. 


Survey  Results 

UTILITY  ASSESSMENT 

The  utility  scores  were  averaged  across  subjects.  Means  and  standard  deviations  were  calculated  by 
feature,  and  across  features  within  a  feature  category.  Looking  at  Table  1,  we  see  that  —  on  average 
—  all  feature  categories  were  judged  more  than  useful  (a  mean  rating  greater  than  three).  This  result 
suggests  that  lAs  perceive  that  most  existing  features  on  current  ELT  systems  are  useful  and  are 
necessary  for  the  job. 
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Table  1.  Mean  utility  ratings  by  feature  category. 


Feature  Category 

Mean 

StDev 

No  of  Features 

Organize  Resources 

4.18 

0.84 

19 

Disseminate  Reports 

4.17 

0.75 

1 

Create  Imagery/Text  Product 

4.11 

0.88 

35 

Detect/Interpret  Object 

r“4.di"“ 

“  l  'd2  “ 

. . . . 44' 

Gather  Relevant  Resources 

fags' 

0.9“2  ' 

10 

Review  tasking 

3.83 

0.41 

1 

An  even  clearer  picture  emerges  when  we  consider  utility  ratings  by  feature.  Figure  5  shows  the 
distribution  of  utility  ratings  across  all  features.  Of  the  1 10  surveyed  features,  103  were  judged  to  be 
at  least  useful  (a  rating  of  three  or  better).  In  addition,  the  majority  of  those  103  features  were  rated 
very  useful  (a  rating  of  four)  or  essential  (a  rating  of  five).  The  six  features  rated  as  essential  all  deal 
with  navigating  through  or  measuring  the  image.  This  result  meets  expectations  since  these  are 
classic  information  extraction  related  activities. 
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Figure  5.  A  frequency  distribution  of  utility  ratings  by  feature. 


Only  seven  of  the  1 10  features  were  not  rated  at  least  useful.  An  examination  of  those  seven  showed 
that  four  dealt  with  image  histogram  manipulation.  Effective  manipulation  of  an  image  histogram 
that  results  in  a  marked  improvement  in  image  quality  typically  requires  some  time  (the  extent  of 
which  depends  on  the  analyst’s  level  of  expertise)  and  a  clear  purpose  --  with  a  well-defined  path 
towards  that  end.  Time  is  at  a  premium  in  the  tactical  exploitation  environment,  so  the  analyst  who 
is  less  experienced  with  the  purpose  for,  and  the  technique  to  adjust,  an  image’s  histogram  will 
typically  elect  not  to  exercise  such  a  feature.  Such  a  decision  can  lead  to  a  vicious  circle,  however, 
because  subsequent  iterations  of  this  situation  will  find  the  analyst  less  and  less  likely  to  employ 
histogram  manipulation  features  as  he  or  she  has  less  and  less  experience  with  this  feature  over  time. 
Therefore,  these  features  may  yet  prove  useful  under  certain  conditions  —  especially  with  increased 
training  with  them. 
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The  next  question  that  needs  to  be  asked  of  these  data  is  whether  the  utility  ratings  change  as  a 
function  of  mission.  Utility  rating  averages  by  feature  were  calculated  separately  for  the  30*  and  the 
480*.  Then,  the  number  of  features  that  each  unit  considered  useful  (a  rating  of  three  or  above)  was 
tallied  and  appears  in  Table  2. 

Table  2.  Feature  utility  ratings  for  the  30th  IS  and  the  480th  IG. 


Number  of  ELT  features  considered  useful  (average  rating  three  or  greater) 

30*  IS 

480"'  IG 

104/110  (94.5%) 

105/110  (95.5%) 

Features  not  considered  useful  (average  rating  less  than  three) 

30*  IS 

480"'  IG 

View  image  histogram  (RGB) 

Vary  glare 

View  Image  histogram  (grayscale) 

invert  video  (negative) 

Manipulate  image  histogram 

Add  pseudo  color  to  a  grayscale  image 

Access  a  personal  folder  of  lA  support 

Paint  or  airbrush  an  image 

tools 

Match  histogram  of  one  image  to  another 

Access  a  personal  folder  of  lA  support 

tools 

Chanae  the  asoect  ratio  of  an  image 

Number  of  useful  ELT  features  that  the  30^^  and  480'"  have  in  common 

100/105(95%) 

Overall,  we  see  that  both  units  considered  about  95%  of  the  features  as  useful.  In  addition,  the  units 
had  a  95%  agreement  on  those  features  which  both  considered  useful.  Table  2  also  lists  those 
features  that  each  unit  did  not  consider  useful.  Some  minor  differences  do  exist  between 
organizations,  but  these  differences  seem  to  be  consistent  with  the  differing  missions  of  these  units. 
For  the  30*  IS  (the  organization  devoted  to  tactical  exploitation)  the  least  useful  features  supported 
object  detection  and  interpretation,  but  from  an  image  manipulation  perspective.  Most  of  these  ‘least 
useful  features’  dealt  with  histogram  manipulation  -  functions  that  are  typically  used  by  the  S&T 
community.  For  the  480*  IG  (whose  mission  tends  to  support  more  supplementary  reporting,  rather 
than  just  tactical  exploitation)  the  least  useful  features  were  again  those  that  supported  object 
detection  and  interpretation  from  the  image  manipulation  perspective,  but  tended  to  be  associated 
with  other  missions.  For  example,  an  ‘invert  video’  feature  tends  to  be  associated  with  the  tactical 
exploitation  community  while  features  such  as  ‘vary  glare’  and  ‘add  pseudo  color...’  tend  to  be 
associated  with  the  S&T  community.  Neither  unit  deemed  the  feature  ‘Access  a  personal  folder  of 
lA  support  tools’  as  useful. 


I/S4  RIUTY  ASSESSMENT 

For  the  purposes  of  this  analysis  of  usability  ratings,  it  was  important  to  discover  which  features  were 
given  the  highest  average  ratings  and  which  ELT  systems  were  responsible  for  these  ratings.  To 
effect  this  examination,  maximum  average  usability  ratings  for  each  feature  were  calculated  for  each 
ELT  system.  For  each  feature,  the  maximum  average  usability  rating  was  determined  and  a 
maximum-average  usability  frequency  distribution  was  generated. 

As  Figure  6  shows,  101  out  of  1 10  rated  features  were  judged  to  be  good  or  excellent  in  usability  in 
at  lea°t  one  ELT  system.  In  fact,  all  rated  systems  contributed  a  maximum-average  usability  rating 
for  at  least  some  of  the  features. 
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Figure  6.  Maximum-average  usability  ratings  frequency  distribution  across  all  ELT  systems. 


The  breakdown  of  ELT  systems  and  maximum-average  usability  ratings  is  shown  in  Figure  7.  These 
two  charts  suggest  that  the  combination  of  all  the  best  features  of  all  the  ELT  systems  considered  in 
this  study  would  result  in  an  almost  completely  effective  user  interface  without  resorting  to  any 
additional  design  work.  In  addition,  one  could  even  come  to  the  conclusion  that  almost  all  of  those 
features  could  be  copied  from  only  four  of  the  seven  surveyed  systems.  However,  despite  the 
obvious  wariness  that  such  a  statement  should  create,  some  other  cautionary  information  should  be 
considered. 


VITec 


IDEX 

23%  (31) 


Figure  7.  Usability  maximum-average  ratings  distribution  by  ELT  system. 

(Note  that  this  chart  does  not  distinguish  where  multiple  systems  share  the  maximum-average.) 
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Table  3  shows  the  usability  rating  coverage  for  each  ELT  system.  The  last  two  columns  in  this  table 
are  especially  important.  The  “rated  features”  column  shows  that,  for  five  systems,  mean  ratings  are 
based  on  data  from  only  one  or  two  lAs.  Several  analysts  —  lacking  experience  with  some  or  all  of 
certain  systems  -  chose  not  to  rate  some  or  all  features  of  the  ELT  systems  with  which  they  were  not 
experienced.  Only  the  VITec  ELT  was  rated  by  every  analyst  on  at  least  some  features.  The  greatest 
number  of  analysts  rating  any  feature  of  any  of  the  other  six  systems  was  three.  Therefore,  only  the 
VITec  usability  ratings  could  be  considered  reasonably  reliable.  Despite  the  questionable  reliability 
of  the  ratings  for  six  of  the  ELT  systems,  however,  the  overall  usability  results  do  suggest  trends  that 
--  when  combined  with  the  utility  results  —  produce  a  clearer  picture  of  where  efforts  should  be 
concentrated  in  improving  ELT  user-interface  design. 


Table  3.  Usability  ratings  coverage  for  each  ELT  system. 


ELT  system 

1-2  ^ 

2-3  ? 

3-4  : 

4-5  ; 

5  : 

Rated  features 

ffoflAs 

VITec 

1; 

22 

631 

24: 

0 

110 

6 

^Matrix 

13 

26; 

27 

23: 

3: 

92 

2 

DIEPS 

11 

25' 

18 

14! 

V 

69 

1 

ERDAS 

o; 

3? 

37 

6T 

1: 

102 

3 

CARS 

8 

22: 

30; 

26: 

24! 

110 

2 

MET 

o; 

3! 

13; 

9 

15; 

40 

1 

IDEX 

20; 

6f 

11; 

26; 

67 

1 

Totals 

53 

107: 

192: 

168 

70| 

UTILITY  AND  USABILITY  COMBINED 

When  utility  and  usability  are  reclassified  as  either  high  or  low  and  then  combined,  a  matrix  emerges 
that  begins  to  bring  the  user-interface  issue  into  focus.  First,  we  address  the  issue  of  reclassification. 
For  utility,  any  feature  with  a  mean  rating  equal  to  or  greater  than  three  was  ‘useful’  and  any  feature 
rated  less  than  three  is  less  than  useful.  Therefore,  three  was  used  as  the  cutoff  for  low  and  high 
utility.  For  usability,  any  feature  with  a  mean  rating  equal  to  or  greater  than  four  had  ‘good’  usability 
and  any  feature  rated  less  than  four  was  ‘fair’  or  worse.  Therefore,  four  was  used  as  the  cutoff  for 
low  and  high  usability. 

Figure  8  represents  a  sort  of  priority  matrix  where  each  quadrant  denotes  features  requiring  greater  or 
leaser  attention.  The  upper  left  quadrant  of  the  matrix  represents  high  utility  and  high  usability,  or 
those  features  that  are  useful  and  are  being  implemented  well.  Ninety-four  of  the  1 10  features  fall 
into  this  category. 

Once  again,  an  effective  ELT  system  could  be  constructed  by  combining  the  best  features  of  existing 
workstations.  A  list  of  all  features  and  where  they  lie  in  priority  with  regard  to  utility  and  usability 
can  be  found  in  Appendix  E. 


14 


CO 

CO 

D 


High 

(>=4) 


Low 

(<4) 


Utility 


94 

Features  being 
done  right 

7 

Features  that 
need  to  be  re¬ 
examined 

9 

Features  for 
which  we  have  a 
high  priority  to 
improve 

•■.cr  - 

(Subtotals) 


(103) 


(101) 


(9) 


(7) 


Figure  8.  A  utility  by  usability  feature  priority  matrix. 

High  priority  features,  or  those  features  that  have  high  utility  but  low  usability,  are  listed  in  Table  4, 
These  are  features  that  need  to  be  redesigned,  as  none  of  the  surveyed  ELT  systems  adequately 
implement  them. 

Finally,  we  have  the  seven  features  that  need  to  be  re-examined.  Again,  we  see  in  Table  5  that  image 
manipulation  features,  especially  those  dealing  with  an  image’s  histogram,  are  deemed  by  this  user 
community  as  not  very  useful.  These  features  need  to  be  re-considered  for  inclusion  in  an  ELT 
system. 


Table  4.  High  priority  features. 


Mean  Max 

Feature  Category _ Feature _ Utility  Usability 

Create  Imagery/Text  Product  Select  all  objects  i  4.33  3.60 

betect/interpret  Object  Enhance  SAP  image  (e.g.  streak  remo\al)  4.17  ^  3.00 

beteciyinterpret  Object  View  Accuracy  Log  (with  estimated  accuracy  of  mensuration  results)  4.17  3.25 

Gather  Relevant  Resources  import  a  file  from  an  external  database  4.17  3.83 

Display  any  comments  associated  with  an  image  (comments  that  are 
Gather  Relevant  Resources  not  part  of  image  or  overlay)  4.00  3.75 

Gather  Relevant  Resources  Open  a  reference  map  for  an  image  3.83  ’  3.50 

Organize  Resources  View  image  status/history  3.67  3J5 

betect/interpret  Object  View  Image  Through  Porthole  3.00  2.66 . 

Organize  Resources  Aspect  Ratio  of  an  Image  3”66  3.66 
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Table  5.  Features  needing  re-examination. 


Feature  Category 

Feature 

Mean 

Utility 

Max 

Usability 

Detect/Interpret  Object 

View  image  histogram  (RGB) 

4.00 

Detect/Interpret  Object 

View  image  histogram  (grayscale) 

2.83 

4.00 

:  Detect/Interpret  Object 

i  Add  pseudo  color  to  a  grayscale  image 

2.83 

4.00 

Create  imagery/text  Product^ 

:  Paint  or  Airbrush  an  Image _  _ 

2.83 

4.17 

DetecT/Interpret  Object 

Manipulate  image  histogram 

2.83 

. 5.00' . 

Gafher  Relevant  Resources 

Access  a  personal  folder  of  lA  support  tools 

Z67 

. 4.00 

Detect/ihteipret  Object 

Match  histogram  of  one  Image  to  another 

2.67 

5.00 

SUBJECT  COMMENTS 

Comments  were  collected  in  order  to  better  interpret  the  more  objective  results.  The  comments 
overwhelmingly  took  the  form  of  suggestions  for  feature  improvements  or  new  features.  The  two 
comments  /  suggestions  that  stood  out  the  most  were  (1)  implementation  of  a  multi-level  ‘undo’ 
feature,  and  (2)  improved  mensuration  accuracy.  Almost  all  analysts  want  the  capability  to  back  out 
of  an  action  or  a  series  of  actions.  Further,  most  analysts  desire  dramatic  improvement  in 
mensuration  accuracy.  The  remainder  of  the  suggestions  took  on  slightly  less  urgency,  but  they  were 
considered  important  nonetheless.  A  large  image  working  area  was  considered  desirable,  and  the 
ability  to  see  the  big  picture  while  scanning  details  (such  as  a  roam  feature  with  an  overview 
displayed  with  the  historical  track  of  the  roaming  activity)  was  desired.  Also,  when  two  images  that 
are  temporally  related  are  loaded  together,  analysts  wanted  to  have  the  cursor  displayed  in  both 
images  simultaneously  -  thereby  allowing  simultaneous  actions  (such  as  zooming)  to  be  performed 
on  both  images.  Many  analysts  desired  a  much  more  fine-grained  adjustment  of  zoom  than  most 
systems  currently  support.  Also,  many  desired  better  annotation  capabilities,  but  were  not  specific  as 
to  how  they  would  improve  existing  systems.  Finally,  almost  all  analysts  wanted  the  capability  to 
customize  ELT  workstation  setup  to  their  own  preferences. 

DISCUSSION 

Although  much  discussion  has  already  been  provided  in  the  results  section,  some  overall  conclusions 
are  offered  here  as  a  summary.  First,  utility  results  suggest  that,  taken  together,  current  ELT  systems 
provide  most  of  the  functionality  needed  by  the  lA  community.  These  results  are  further  supported 
when  usability  is  also  considered.  However,  no  one  ELT  system  currently  provides  all  required 
functionality  or  adequate  implementation  of  that  functionality. 

Based  on  the  current  results,  almost  all  of  the  rated  features  should  be  included  in  any  future  ELT 
system  design.  Overall  ratings,  however,  suggest  that  some  features  should  be  discarded  (see  again 
Table  5).  However,  these  are  features  that  appeal  to  the  S&T  exploitation  community;  their  inclusion 
may  not  be  in  question,  but  perhaps  they  should  be  de-emphasized  in  configurations  aimed  at  tactical 
exploitation.  Another  interpretation  of  these  low  utility  and  usability  ratings  could  be  that  none  of 
the  current  ELT  systems  do  a  good  job  implementing  these  features,  and  that  the  poor 
implementations  led  to  less  usefulness. 

There  is  also  a  need  for  flexibility  based  on  mission  and  individual  preference.  Inexperienced 
analysts  were  very  unsure  of  their  information  extraction  capabilities.  For  example,  several  lAs 
expressed  uncertainty  when  attempting  to  identify  targets  as  tanks  versus  armored  personnel  carriers 
—  despite  the  high  resolution  (one-foot)  and  clear  quality  of  the  SAR  imagery.  Since  most  of  these 
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analysts  actually  performed  well  during  the  exercise,  this  lack  of  confidence  might  suggest  that 
analysts  don’t  get  enough  training  where  ground  truth  is  known  and  reliable  feedback  on  accuracy  of 
assessments  can  be  obtained. 

Most  current  systems  seem  to  do  an  adequate  job  of  supporting  lA  requirements  while  performing 
activities  that  support  information  extraction,  but  several  features  could  use  improvement  in 
usability.  Some  of  the  areas  not  particularly  well  supported  by  existing  systems  are  some  aspects  of 
orientation  (such  as  translating  the  requirements  of  the  task  order  into  an  effective  exploitation  plan) 
and  of  reporting  (such  as  an  integrated  approach  to  object  annotation). 

Some  new  interface  concepts  to  address  some  of  these  deficiencies  are  listed  below. 

•  Contextual  functionality  (not  unlike  context-sensitive  help) 

•  Customizable  user  configuration  profiles 

•  Integration  of  target  annotation  and  reporting 

•  On-line  target  keys 

Contextual  functionality  is  functionally  similar  to  context-sensitive  help  in  that  it  would  allow  the 
user  to  specify  the  actions  carried  out  by  certain  controls  (such  as  mouse  buttons),  as  a  function  of 
which  mode  the  user  was  in.  For  example,  under  certain  conditions,  the  left,  middle,  and  right  mouse 
buttons  may  control  window  navigation  or  file  management,  but  when  using  the  zoom  feature,  these 
buttons  would  control  the  degree  and  directionality  of  the  zoom  feature.  Some  of  this  capability  is 
already  resident  in  these  systems,  mostly  due  to  X-Windows  conventions.  Notwithstanding  that, 
more  integration  of  this  kind  of  capability  directly  into  exploitation  systems  together  with  the  ability 
for  users  to  individually  specify  attributes  of  this  capability  is  desired. 

Customizable  user  configuration  profiles  may  be  likened  to  user  preferences,  but  extend  the  concept 
somewhat.  Rather  than  just  storing  a  set  of  initialization  variables  for  particular  functions,  this 
function  would  allow  users  to  save  individual  feature-usage  preferences  -  as  well  as  their  operation 
preferences  —  at  higher  levels.  For  example,  a  user  would  be  able  to  specify  zoom  feature 
functionality  as  specific  to  him  or  her.  From  a  different  perspective,  a  user  would  be  able  to 
configure  the  layout  of  toolbars  and  menus  according  to  personal  preference  by  mission  (e.g., 
configuration  x  for  tactical  exploitation  with  SAR  imagery  and  configuration  y  for  S&T  exploitation 
with  electro-optical  (EO)  imagery).  In  addition,  these  kinds  of  preferences  could  then  be  tied 
together  in  combinations  when  the  need  arises. 

Integration  of  target  annotation  and  reporting  and  on-line  target  keys  are  depicted  in  Figure  9.  In  the 
figure,  we  see  the  LA  diligently  exploiting  some  SAR  imagery.  The  LA  begins  by  opening  his  ‘smart’ 
task  order,  which  has  already  electronically  cued  various  imagery  and  text  report  searches  for  the 
relevant  files  he  needs.  After  the  lA  reads  the  task  order  questions,  he  opens  relevant  imagery  files  in 
order  to  orient  himself.  As  he  opens  the  images,  the  system  immediately  plots  them  on  ‘oil  stock’  or 
vector  maps  and  affixes  collection  time  tags  to  each  image.  The  lA  then  begins  to  group  various 
images  together  in  mosiacs  by  simply  selecting  the  individual  images  and  saving  the  collections  as 
objects. 


17 


Figure  9.  Integrating  two  new  interface  concepts. 

After  defining  the  various  imagery  objects,  he  begins  the  target  detection  and  identification  process. 
To  help  the  lA  make  the  correct  identifications  so  critical  to  the  accuracy  of  the  subsequent  report, 
on-line  target  keys  would  be  available  to  assist  him.  The  keys  would  work  by  displaying  what 
different  targets  may  look  like  based  on  known  imagery  and  environmental  attributes.  For  example, 
if  the  lA  suspected  a  target  as  being  a  BMP-2  armored  personnel  carrier  (APC),  he  could  ask  the 
target  key  module  to  provide  an  image  chip  that  would  look  like  that  target  in  a  certain  orientation. 
The  module  would  handle  the  calculation  of  this  image  chip  by  taking  into  account  known  attributes 
of  the  sensor  (such  as  resolution  and  depression  angle)  and  target  reflectivity  models,  to  simulate  the 
SAR  return  of  a  BMP-2  under  the  current  conditions.  The  keys  would  work  as  primers  to  the 
imagery  analyst’s  own  pattern  recognition  abilities  -  as  opposed  to  a  true  automatic  target 
recognition  (ATR)  system. 

As  the  lA  annotates  the  imagery,  target  identification  data  and  location  data  are  automatically 
compiled  into  a  text  report  template  without  the  lA  having  to  manually  generate  the  text  report  later. 
The  annotation  data  could  also  feed  a  database  in  near  real-time  that  would  roll  up  to  battlefield  or 
theater  situation  awareness  displays  at  the  higher  command  levels. 

Appendix  F  describes  the  user-interface  requirements  for  an  ELT  system  that  would  support  the  Air 
Force  intelligence  mission  through  quick  and  effective  imagery  exploitation.  Such  a  system  would 
support  the  three  main  areas  of  imagery  exploitation  (orientation,  information  extraction,  and 
reporting),  and  provide  the  Air  Force  imagery  /  intelligence  analyst  with  the  most  effective  toolset  for 
the  exploitation  of  all  types  of  digital  imagery. 

These  types  of  interface  improvements  are  all  within  the  scope  of  current  or  near-term  technologies. 
The  actual  exploitation-performance  benefits  that  would  be  derived  through  application  of  these 
concepts  remains  a  topic  for  further  study. 
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GLOSSARY  OF  ACRONYMS 

Armored  Personnel  Carrier 

American  Standard  Code  for  Information  Interchange 
Automatic  Target  Recognition 
Basic  Encyclopedia  Number 
Command,  Control,  and  Communications 

Command,  Control,  Communications,  Computers,  and  Intelligence 

Combat  Airborne  Reconnaissance  System 

Community  Imagery  Training  Council 

Cognitive  Task  analysis 

Defense  Advanced  Research  Projects  Agency 

Digital  Imagery  Exploitation  Production  System 

Detect  /  Identify  and  Type 

Department  of  Defense 

Electronic  Light  Table 

Exploitation  Support  Data 

Graphics  Interchange  Format 

Geographic  Information  System 

Hardcopy 

Imagery  Analyst 

Imagery  Data  Exploitation  System 
Imagery  Intelligence 
Intelligence 

Joint  Photographic  Experts  Group 
Multi-Image  Exploitation  Tool 

Moving  and  Stationary  Target  Acquisition  and  Recognition 
National  Air  Intelligence  Center 
National  Image  Interpretability  Rating  Scales 
National  Imagery  Transmission  Format 
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PI 

PME 

S&T 

SAR 

SC 

SIGINT 
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TIFF 
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Order  of  Battle 
Photo  Interpreter 
Primary  Mission  Equipment 
Science  and  Technology 
Synthetic  Aperture  Radar 
Softcopy 

Signals  Intelligence 
Subject  Matter  Expert 
Sandia  National  Laboratory 
Tagged  Image  File  Format 
Timeline  Management  Tool 
Universal  Transverse  Mercator 
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APPENDIX  A:  ENTRY  LEVEL  lA  TRAINING  STANDARDS 


1 .  The  imagery  functional  manager  has  approved  the  following  entry-level  imagery  analyst  (lA) 
training  standards  adopted  by  the  Community  Imagery  Training  Council  (CITC)  at  the  7  November 
1996  meeting.  These  skills  were  derived  from  a  detailed  corporate  analysis  of  current  lA  tasks 
common  across  the  lA  workforce,  by  CITC  subcommittees.  All  organizations  that  provide  entry- 
level  instruction,  or  participate  in  the  development  or  implementation  of  on-the-job  training  programs 
are  to  immediately  enact  these  standards  in  their  course  curriculum. 

2.  The  training  standards  listed  in  paragraphs  3  through  5  relate  to  required  core  lA  skills.  The 
standards  specify  ‘what’  lAs  must  understand  or  be  able  to  perform,  but  now  ‘how’  the  skills  are 
acquired.  As  such,  entry-level  skills  are  not  intended  to  equate  to  particular  courses  of  instruction, 
but  provide  total  flexibility  to  imagery  training  programs  in  the  timing  and  method  of  training 
delivery.  Thus,  skills  taught  by  one  organization  in  a  classroom  could  be  taught  through  on-the-job 
training  (OJT),  mentoring  or  self-study,  or  by  other  organizations.  Skills  are  categorized  functionally 
by  ‘knowledge’  or  ‘performance’.  Each  has  an  associated  required  competency  level. 

a.  The  knowledge  competency  levels  are: 

(1)  KB  =  demonstrate  basic  facts  and  concepts 

(2)  KD  =  demonstrate  detailed  understanding 

(3)  SK  =  function  as  a  subject  matter  expert 

b.  The  performance  competency  levels  are: 

(1)  PS  =  perform  task  while  supervised 

(2)  PU  =  perform  task  unsupervised 

c.  The  core  skills  discussed  in  paragraphs  3  through  5  are  not  intended  to  convey  priorities  of 
importance  or  to  suggest  training  topic  sequence. 

3.  Entry  level  LA  exploitation  core  skills. 

a.  Category:  Understand  intelligence  (INTEL)  community,  imagery  community,  imagery 

security.  Core  skills  and  competency  levels  are: 

(1)  awareness  of  INTEL  community  roles  /  responsibilities  (KB) 

(2)  awareness  of  history  of  imagery  intelligence  (IMINT)  and  reconnaissance  (KB) 

(3)  identify  current  types  of  sensors  and  platforms  (KB) 

(4)  identify  and  define  elements  of  the  intelligence  cycle  and  imagery  cycle  (KB) 

(5)  understand  /  use  info  security  procedures  (KB,  PS) 

(6)  understand  /  use  physical  security  procedures  (KB,  PS) 

(7)  understand  /  use  imagery  security  policy  and  procedures  (KB,  PS). 

b.  Category:  (Tools)  Exploit  hard  copy  (HC)  imagery.  Core  skills  and  competency  levels  are: 

( 1 )  operate  light  table  functions  (PU) 

(2)  set  up  light  table  for  different  types  of  HC  imagery  (PU) 

(3)  adjust  light  table  optics  (PU) 

(4)  use  universal  reference  grid  to  locate  objects  and  determine  grid  locations  (PU) 

(5)  set  up  HC  imagery  for  stereo  viewing  (PU). 

c.  Category:  (Tools)  Exploit  soft  copy  (SC)  imagery.  Core  skills  and  competency  levels  are: 

(1)  use  basic  workstation  functionality  (PU) 
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(2)  display  and  manipulate  SC  imagery  on  a  workstation  (PU). 

d.  Category:  (Tools)  Use  exploitation  support  data  systems.  Core  skills  and  competency 
levels  are: 

(1)  identify  lA  task  assignments,  priorities  and  suspenses  from  data  base  (PU) 

(2)  identify  lA  task  external  environment  interface  (EEI),  security  and  releasability 
requirements  from  data  base  (PU) 

(3)  identify  imagery  history  of  coverage  by  target  and  geo-reference  from  database  (PU) 

(4)  identify  previous  target  and  topical  imagery  reports  from  database  (PU) 

(5)  determine  image  suitability  for  assigned  lA  task  (PU) 

(6)  determine  predicted  imagery  coverage  (PS) 

(7)  determine  available  collateral  data  (PS) 

(8)  extract  activity  normalcy  and  deviation  reporting  tolerances  from  database  (PU) 

(9)  determine  map  and  geographic  information  system  (CIS)  references  (PU) 

(10)  determine  direction  of  an  image  using  data  system  and  image  titling  (PU) 

(11)  utilize  exploitation  support  data  (ESD)  and  mensuration  support  data  (MSD)  (PU) 

(12)  create  a  formatted  lA  target  report  (PS) 

(13)  create  a  formatted  lA  topical  report  and  a  free  text  lA  report  (PS) 

(14)  create  an  annotated  imagery  product  (HC  and  SC)  (PS) 

(15)  locate  and  extract  imagery  from  a  HC  image  library  (PU) 

(16)  locate  and  extract  imagery  from  a  digital  SC  image  library  (PU) 

(17)  distribute  a  HC  image  product  to  a  customer  (PS) 

(18)  disseminate  electronically  a  SC  image  product  into  a  digital  image  product  library  / 
archive  and  to  a  customer  (PS). 

e.  Category:  Use  basic  exploitation  techniques,  (HC  and  SC)  using  optical,  radar,  and 
infrared  (IR)  imagery.  Core  skills  and  competency  levels  are: 

(1)  determine  image  National  Image  Interpretability  Rating  Scales  (NIIRS)  rating  (KB, 
PS) 

(2)  determine  NIIRS  rating  needed  to  accomplish  an  lA  task  (PS) 

(3)  determine  dimensions  of  an  object  on  imagery  using  local  control  (PS) 

(4)  determine  dimensions  of  an  object  on  HC  imagery  using  image  scale  and  a  reticule 
(PS) 

(5)  determine  dimensions  and  geo-location  of  an  object  on  SC  imagery  and  a  reticule 
(PS) 

(6)  use  latitude  and  longitude  to  locate  points  on  map  (PS) 

(7)  use  Universal  Transverse  Mercator  (UTM)  to  locate  points  on  a  map  (PS) 

(8)  use  maps  and  map  symbology  to  extract  data  (PS) 

(9)  correlate  a  specific  point  on  a  map  with  the  same  point  on  an  image  (PS) 

(10)  explain  differences  between  physical  and  cultural  geography  (KB) 

(11)  determine  elevations  on  a  map  using  contour  lines  (PS) 

(12)  detect,  identify,  and  classify  an  object  on  imagery  using  an  imagery  key  (PS) 

(13)  understand  and  use  image-titling  data  (KB,  PS) 

(14)  understand  perspective  and  obliquity  on  an  image  (KB) 
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(15)  use  the  “5  Ss”(size,  shape,  shadow  and  surroundings)  and  give  examples  of  each 
(PS) 

(16)  understand  and  use  techniques  for  searching  imagery  (KB,  PS). 

f.  Category:  Perform  imagery  interpretation  and  analysis  (HC  and  SC)  using  optical  and  radar 
imagery;  be  familiar  with  basic  terminology  /  nomenclature  of  equipment  and  organizations 
observed  on  imagery.  Core  skills  and  competency  levels  are: 

For  geography,  transportation: 

(1)  detect  /  identify  road,  rail,  air  and  water  surface  transportation  (PS) 

(2)  understand  relation  between  geography  and  military  capabilities  (KB) 

(3)  understand  relation  between  geography  and  military  capabilities  (KB) 

(4)  use  terrain  analysis  concepts  to  identify  avenues  of  approach  and  barriers  to  mobility 

(PS) 

For  naval  order  of  battle  (OB): 

(1)  detect  /  identify  and  type  (D/I/T)  naval  and  merchant  shipping  and  storage  facilities 

(PS) 

(2)  D/I/T  and  class  surface  combatants,  submarines,  merchant  ships  and  auxiliaries  (PS) 

(3)  determine  naval  OB  normalcy,  status  and  changes  (PS). 

For  missile  OB: 

(1)  D/I/T  missiles,  missile  launchers  (mobile,  silo,  fixed,  and  space),  missile  canisters 
and  missile  support  systems  (PS) 

(2)  D/I/T  missile  bases  and  support  facilities  and  infrastructure  (PS) 

(3)  D/I/T  missile  field  deployments  (PS) 

(4)  D/I/T  mobile  missile  test  facilities  (PS) 

(5)  determine  missile  OB  normalcy,  status,  and  changes  (PS). 

For  air  OB: 

(1)  D/I/T  aircraft,  including  helicopters  and  naval  air  (PS) 

(2)  D/I/T  airfields,  air  facilities,  air  delivered  weapons  and  weapons  canisters,  crates  and 
storage  facilities  (PS) 

(3)  D/I/T  air  related  ground  support  equipment  (PS) 

(4)  determine  air  OB  normalcy,  status,  and  changes  (PS). 

For  C4I  /  electronics: 

(1)  D/I/T  fixed  C3  equipment  and  sites,  including  microwave,  high  frequency  (HF),  low 
frequency  (LF),  etc.  (PS) 

(2)  D/I/T  mobile  C3  equipment,  deployed  and  in  garrison  (PS) 

(3)  D/I/T  fixed  radar  equipment  and  sites  (PS) 

(4)  D/I/T  mobile  radar  equipment,  deployed,  and  in  garrison  (PS) 

(5)  determine  C4I  /  electronics  normalcy,  status  and  changes  (PS). 

For  ground  OB: 

(1)  D/I/T  ground  forces  equipment,  including  tanks,  APCs,  artillery,  multiple  rocket 
launcher  systems  (MRLS),  wheeled  and  tracked  transports  (PS) 

(2)  D/I/T  engineer  equipment,  tactical  air  defense  equipment,  and  tactical  missile 
systems  (PS) 

(3)  D/I/T  chemical,  biological  and  radiological  warfare  equipment  (PS) 
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(4)  identify  ground  forces  training  areas,  obstacle  courses,  active  and  passive  defenses, 
obstacles  and  barriers  (PS) 

(5)  identify  major  ground  force  facilities  and  infrastructure  including  barracks, 
headquarters  areas,  munitions  and  fuel  storage  areas  (PS). 

For  industry: 

(1)  identify  the  major  categories  of  industry,  (i.e.,  mining,  factories,  power  production 
and  service)  (KB,  PS) 

(2)  identify  military  related  industries,  especially  production  and  testing  of  major 
weapons  systems  (PS) 

(3)  identify  industrial  components  (i.e.,  supply  yards,  fabrication  buildings,  substations, 
loading  docks)  (KB,  PS) 

(4)  identify  production,  testing  and  storage  facilities  for  weapons  of  mass  destruction 
(PS) 

(5)  determine  industrial  normalcy,  status,  and  change  (PS). 

Additional  areas: 

(1)  identify  denial  and  deception  activity  (PS) 

(2)  identify  capabilities  of  different  sensors  and  platforms  to  defeat  defense  in  depth 
(KB) 

(3)  perform  damage  analysis  (PS) 

(4)  identify  weapons  effects  data  (i.e.,  use  DOD  publications)  (PS) 

(5)  identify  sensor  advantages  and  limitations  for  damage  analysis  (KB). 

4.  Entry  level  lA  collection-related  core  skills. 

a.  Category:  Imagery  sensor  capabilities  and  limitations.  Core  skills  and  competency  levels 
are: 

(1)  identify  basic  capabilities  of  current  sensors  and  platforms,  including  literal  vs.  non¬ 
literal  imagery;  sun-synchronous  vs.  non-sun-synchronous  platforms  (KB) 

(2)  identify  capabilities  and  limitations  of  current  sensors  and  platforms  (KB) 

(3)  identify  impact  of  vehicle  attitude  on  NIIRS,  target  size,  and  collection  competition 
(KB) 

b.  Category:  Imagery  requirements  management  procedures  and  terminology.  Core  skills  and 
competency  levels  are: 

(1)  understand  community  role  in  developing  imagery  priorities  (KB) 

(2)  identify  differences  between  routine  nominations  and  ad  hoc  nominations  (KB) 

(3)  understand  differences  between  priority  and  immediate  ad  hoc  nominations, 
including  approval  process  and  duration  of  collection  (KB) 

(4)  understand  role  of  the  requirements  manager,  including  nominations  research  and 
nominations  submission  (KB) 

(5)  understand  types  of  imagery  targets  and  the  associated  collection  implications  (KB) 

5.  Entry  level  lA  imagery  processing-related  core  skills. 

a.  Category:  Optics  and  imaging.  Core  skills  and  competency  levels  are: 

(1)  identify  concept  of  the  electromagnetic  spectmm-(KB); 

(2)  identify  basic  concepts  of  optics  and  optical  characteristics-(KB); 
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(3)  identify  basic  collection  sensor  concepts  and  characteristics-(KB). 

b.  Category:  Photographic  processing  (HC).  Core  skills  and  competency  levels  are: 

(1)  identify  basic  terminology  and  functional  concepts  of  conventional  photo 
processing,  including  duping,  printing,  enlarging,  emulsions-(KB); 

(2)  read  HC  film  titling-(PS); 

(3)  demonstrate  proper  film  handling  procedures-(PS); 

(4)  understanding  that  there  is  a  process  for  requesting  photo  lab  services-(KB). 

c.  Category:  Digital  imagery  processing  (SC).  Core  skills  and  competency  levels  are; 

(1)  identify  basic  terminology  and  functional  concepts  of  digital  imagery  processing- 
(KB); 

(2)  demonstrate  operation  of  a  digital  workstation,  including  adjusting  display  and  doing 
digital  printing-(PS); 

(3)  understand  basic  concepts  of  primary  and  secondary  electronic  imagery 
dissemination,  including  dissemination,  including  communications  considerations- 
(KB); 

(4)  understand  basic  procedures  for  scanning  images-(KB). 


27 


This  page  left  blank  intentionally. 


28 


APPENDIX  B:  MSTAR  DATA  COLLECTION 


A  Moving  and  Stationary  Target  Acquisition  and  Recognition  (MSTAR)  program  data  set  was 
collected  in  September  of  1995  at  the  Redstone  Arsenal,  Huntsville,  AL  by  the  Sandia  National 
Laboratory  (SNL)  “STARLOS”  SAR  sensor  platform.  The  collection  was  jointly  sponsored  by 
DARPA  and  Wright  Laboratory  as  part  of  the  MSTAR  program.  SNL  .used  an  X-band  SAR  sensor 
in  one  foot  resolution  spotlight  mode.  Strip  map  mode  was  used  to  collect  the  clutter  data. 

A  subset  of  the  data  from  the  September  1995  collection  has  been  identified  by  DARPA  and  Wright 
Laboratory  for  public  release. 

For  more  information  on  the  MSTAR  imagery  and  tools,  the  reader  is  directed  to  the  MSTAR  project 
portion  of  the  Sensor  Data  Management  System  (SDMS)  World  Wide  Web  site  at 
http://www.mbvlab.wpafb.af.mil/Dublic/sdms/main.htm  or  by  electronic  mail  at 
cd_help@mbvlab.wpafb.af.mil. 
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APPENDIX  C:  EXPLOITATION  SCENARIO  TASK  ORDER 
Possible  Russian  Peacekeeping  Operation  Violations  in  Abkhazia 


Background 

During  the  past  year,  Georgian  and  Abkhazian  relations  have  continued  to  be  volatile.  Followin<y  the 
1992-1993  fighting,  which  was  met  by  Russian  Peacekeeping  Operations  (PKO),  hostilities  have° 

u  •’^ve  been  reported  to  range  from  700-1200  includin<^ 

the  90  st  Air  Assault  Battalion  and  the  90 1  st  Motorized  Rifle  Regiment  (Provisional).  Russian 
forces  remained  following  the  1992  occupation,  as  there  have  been  six  separate  cease-fire 
agreements,  all  of  which  have  been  violated  by  one  or  more  parties.  The  Russian  PKO  now  tends  to 
be  comprised  of  a  largely  Abkhazian  descendent  force  and,  therefore,  has  emotional  ties  to  the  local 


The  Abkhazians  have  been  increasingly  more  adamant  for  sovereignty  from  Georgian  rule.  The 
Ukrainian  National  Self-Defense  Organization  (UNSO)  has  recently  become  more  active  in 
supporting  the  Georgian  political  leadership  in  conducting  operations  against  the  Abkhazian  capital 
city  of  Sukhumi.  Reports  from  Sukhumi  indicate  the  UNSO  have  infiltrated  an  area  in  the  northeast 
section  of  the  city  and  have  between  200  and  500  troops  equipped  with  small  arms,  BMP-2  armored 
vehicles,  and  are  possibly  m  possession  of  chemical  devices.  Recent  HUMINT  indicated  they 
intended  to  poison  the  area’s  sole  fresh  water  supply  -  a  large  reservoir  north  of  the  capital  city  -  on 

nr  s  Anmicf  1 0Q'T  ^ 


Russian  forces  were  deployed  from  the  provisional  garrison  area  to  disperse  the  UNSO  activity.  The 
ussian  force  was  to  serve  only  as  PKO  and  not  take  open  action  against  the  UNSO.  Reports  from 
the  Georgian  government  indicate  the  Russian  forces  may  have  attacked  the  UNSO  operations  center 
with  armored  infantry  and  T-72s,  possibly  destroying  two  BMP-2s  and  driving  the  remaining  forces 
!  Georgian  government,  the  Russian  forces,  “savagely  attacked  peaceful 

UNSO  si^porters  killing  over  100  civilians  and  destroying  several  government  buildings  and 
homes.  Russian  military  leaders  in  Sukhumi  state  that  no  tanks  have  left  garrison  and  their  only 
action  has  been  to  defend  the  reservoir  from  possible  contamination. 


The  Georgian  and  Ukrainian  governments  have  made  a  plea  to  the  Russian  President  to  recall  the 
forces  and  have  asked  the  United  Nations  (UN)  to  investigate  the  alleged  actions  by  the  Russian 
forces.  The  area  of  interest  had  only  sparse  MINT  coverage  during  the  time  of  these  actions.  No 
emphasis  was  placed  on  collection  or  reporting  as  these  actions  were  viewed  of  little  impact  at  the 
time.  The  UN  has  asked  the  data  be  reviewed  for  indications  of  possible  Russian  offensive  actions 


Reporting  Requirements 

Provide  annotated  imagery  of  any  unusual  activity  such  as:  deployment  of  armor  (number  and  type) 
indications  of  actions  against  fresh  water  supply,  battle  damage,  and  any  significant  military 
operations. 


Generate  summary  intelligence  report  (1  short  text  report  w/  annotated  support  imagery). 
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Support  Material 


Imagery 

Reservoir  and  suspected  UNSO 

The  following  1-foot  SAR  imagery  products  are  provided.  (The  STARLOS  sensor 
depression  angle  collected  this  imagery.)  _ 


Filename  1  BE  number  i  Acquisition 

■  .  .  „  •  ’p  ,  Date  -  l 


Description 


61810806.NTF 


61 820806.NTF 


^05FB06182 


61 830806.  NTF 


‘61 840806.NTF 


61810808.NT?' 


[305FB06T83 


j305FB06184 


|305FB061^ 


61 820808.NTF 


161830808.NTF 


^OSFBOei^ 


OUMIumi  X - i - - 

1901  St  Motorized  Ftitle  Regiment  Provisional 

i  fiarrison  (frame  181) _ ^ ^ — - - 

'06-Aug-97  901st  Motorized  Rifle  Regiment  Provisiona 
Garrison  (frame  182)  - 

••I  — - T  T  Li 


06-Aug-97 


06-Aug-97 


08-Aug-97 


i-iarnson  inainc  ^ - - 

^oistMotorizedRifle  Regiment  Provisional 
inarrison  (frame  183) 

I — _  T  • I 


c-jarnson  ufctmo  - - - - - - - 

901st  Motorized  Ritle  Regiment  Provisional 

(Garrison  (frame  184) 

— — — T  • _ I 


08-Aug-97 


inarrisuti  iiiamo  _ _ _ — — : - - 

901st  Motorized  Rifle  Regiment  Provisiona 
Garrison  (frame  453) 

- - - - T~Z  T  - _ I  r^:£l 


305FB6'6TMT~08-Aug-97 


61840808.NTF 


62050^10d^ 


(^arnsofi  _ _ _ r~: - 7-* 

^goiiTMotorized  Rifle  Regiment  Provisional 

Garrison  (frame  454) _ ^ - p- 

g^^ifMot^ed  Rifle  Regiment  Provisional 


305FB06W 


305FB06205 


•  _  ..J - - - - - 

120^81 0.NTF  I305FB06206 


6207081 0.NTF 


305FB06^ 


6237081 0.NT^ 


6238081  Ot^F 


623908Tb.NTF 


305FB06237 


I  wv  — - 

Garrison  (frame  455j - - - - - - 

-08:^1^97 WtiTM^to^ Rifle  Regiment  Provisional 
Garrison  (frame  456) 

“Z  "  "TT’-i  I  iMor^  ur 


10-Aug-97 


10-Aug-97 


10-Aug-97 


Gusoected  UNSO  HQ  (frame  477^ 

I - - -  .  .  I  /f _ _  A-7Q\ 


-  ^ _ _ _ _ _ 

Suspected  UNSO  HQ  (frame  478) 

. . . . . .  ^  _ _ j17Q\ 


‘365FB06238 


305FB06^ 


•  _  I _ — — - - 

6240081 0.NTF  i305FB0624C) 


10-Aug-97 


-  X  - - - - — 

Fq.  .Qnartad  UNSO  hQ  (frame  A79)_ 

- — r-zT  “■  •  -  _ _  cno\ 


Sukhumi  Reservoir  (frame  509) 

_ —  — . 


10-Aug-97 


10-Aug-97 


10-Aug-97 


Sukhumi  Reservoir  (frame  510) 

I . . . . . .  r*  U  ^  \ 


1  Sukhumi  Reservoir  (frame  511) 

! — - — ^ — /r _ c- H  o\ 


»^ur\i  iw I  i  •»  ■  ■  ^  ^  -  V  _ _ _ _ _ 

iSukhumi  Reservoir  (frame  512) 


Maps 

No  localized  maps  are  available. 

Other  Sources, 

A„  avanable  HUMINT  and  S.OINT^rces  suggest  nomaal 


UNSO  pajamilitarv  forces _ _ _ _ - 

Russian’901®'  Motorized  Rifle  Regiment 
(Provisional) 


"l 0-20  XT-72 
15-30  X  BMP-2 
10-20  X  BTR-70 
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61810806  61820806  61810808  61820808 
Garrison  Area  -  06  August  Garrison  Area  -  08  August 


62370801  62380801  62370810  62380810 

Reservoir  Area  -  01  August  Reservoir  Area  - 1 0  August 


62060801  62070801  62060810  62070810 

Suspected  UNSO  HQ  -  01  August  Suspected  UNSO  HQ  - 10  August 

Figure  C-1.  Some  representative  images  from  the  exploitation  exercise  imagery  set. 


Note:  the  above  images  are  not  inclusive  of  the  entire  imagery  set,  but  they  represent  the  important 
subset  of  imagery  where  spatial  and  temporal  changes  may  be  detected. 


This  page  left  bltink  intentionally. 
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APPENDIX  D:  UTILITY  AND  USABILITY  SURVEY 


Utility  and  Usability  Assessment  of  lA  Workstation  Features 

Name _ 

Unit _ 

Experience  (yrs) _ 

Purpose:  This  survey  is  designed  to  elicit  your  input  regarding  the  utility  and  usability  of  various  features 
supported  by  image  analyst  workstations.  Results  will  help  researchers  and  developers  identify  which 
workstation  tools  /  features  are  most  useful  and  valuable  to  the  image  analyst,  and  2)  how  these  tools  should  be 
implemented  such  that  they  are  easy  to  use. 

Instructions:  Listed  on  the  following  pages  is  a  number  of  features  available  in  various  image  analyst 
workstations.  (No  one  system  supports  all  of  the  features.)  For  each  feature,  you  are  asked  to  assign  two 
ratings.  The  first  rating  is  for  the  general  utility  of  the  feature.  This  means  how  useful  you  feel  the  given  feature 
is  to  the  image  analyst.  This  assessment  is  for  the  feature  in  general,  independent  of  how  it  is  implemented  with 
any  given  system.  The  second  rating  addresses  usability  of  the  feature.  The  usability  rating  you  assign  to  a 
feature  reflects  your  assessment  of  how  easily  a  given  feature  is  performed  with  a  particular  system. 

If  you  are  familiar  with  more  than  one  particular  workstation,  you  are  asked  to  assess  the  usability  of  each 
workstation,  with  which  you  are  familiar,  for  performing  the  given  task.  Please  rate  the  features  using  the 
following  scales. 

Utility  Rating  Scale 

5  =  The  feature  is  essential  to  the  image  analyst 

4  =  The  feature  is  very  useful  to  the  image  analyst 

3  =  The  feature  is  useful  to  the  image  analyst 

2  =  The  feature  is  slightly  useful  to  the  image  analyst 

1  =  The  feature  is  useless  to  the  image  analyst 

Usability  Rating  Scale 

5  =  The  usability  of  the  feature  as  implemented  is  excellent 

4  =  The  usability  of  the  feature  as  implemented  is  good 

3  =  The  usability  of  the  feature  as  implemented  is  fair 

2  =  The  usability  of  the  feature  as  implemented  is  poor 

1  =  The  usability  of  the  feature  as  implemented  is  extremely  poor 
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Usabilty  (by  workstation) 


Functional  Category 


Organize  Resources 

Gather  Relevant  Resources 

Gather  Relevmt  Resources 

Gather  Relevant  Resources 
Create  Imagery  RrodiKf 
Gather  Relevant  Resources 
Create  ImagMY  Rix^uct 
Create  Imagery  Product 
Gather  jFbftlevant  l^ources^ 
Create  Inragery  Product 
Gather  Relawit  Resources 
Gather  Relevant  Resources 
Create  hmagery  Fh^uet 
Review  Tasking 
Create  Text  Pro<hict 

Create  Text  Product 

Create  imagery  Product 
Create  Imagery  Product 
Create  Imagery  Product 
Create  Text  Product 
Gather  Relevant  Resources 
Disseminate  Reports 
Organize  Resources  ^  . 
Organize  Resources 
Organize  Resources 
Organize  Resources 
j  i^^e^ources 

Organize  Resources 
I  Create  Imagery  F^noduct 
Create  Imagery  Product 
Creete  Imagery  F^oduct 
Detect/Interpret  Object 
Detect/lnlerpret  Object 
I  Detect/Interpret  Object 
Datect/lnterpret  Oiqect 
Organize  Resources 
Detect/Interpret  Oi^ect 
Detect/Interpret  Object 
Organize  Resources 


Detect/Interpret  Object 
Detect/Interpret  Ot^ect 
Detect/Interpret  Object 


iFunction 


OpenATi^  mutUple  images  santaneously 

Filter  a  list  of  files  in  a  directory  (i.e.,  list 
only  files  with  a  given  character  string  in 
the  filename  or  extension) 

Query  a  database  {irdemal  dr  external] 
(e.g.  search  by  BE  #,  lat/l^,iTiJfi  region, 
instailaticm  narn^  equipnraiitt^  etc.) 
Identify  images/reports  associated  with  a 
given  image 

Unk/tasoeiale  support  files  tow  Image, 
object  category,  OB,  ate.) 

Import  a  file  from  an  external  database 
Export  (save)  a  file  to  an  extemai  . 

■  dataiwisa 

Save  a  file  in  a  different  file  format 


VITec  ELT I 

Matrix  I 

DIEPS5DI 

1  ERDAS 

Loadrmittispaelral  fanagaiY 
Digitize  an  Image  (from  exterr\al  device 
e.g,  scanner.) 

Access  a  persowl  folder  of  (A  support 
: tools-.  ' 

Open  a  raferer>ce  map  for  an  image 
Open  mwmolation  overlay  ^  ::i. 

Open  a  text  file 

Open  a  rwtepad^  ;  _ 

Autorecord  Data  (e.g.  mensuration  data) 
to  the  Notepad 


Print  entire  screen 

“Bum  In*  Overlays  (onbed  overtay  in 
Edit  File  Header 


Ftecehre  an  MTF  file  (COMM  function) 


Transmit  an  NFTF  file  (COMM  function) 
Specify  image  distrflHitioh  :  V  V 
Create  a  mosaic 
Cascade  Mutt^  Windows 
Tile  Multiple  Windows 
Arrw^  kons'.dr Tdotbars ;  : 

Resize  a  window 

Cut/Coipy/Pasta  {Chip)an  irnagereg^l^ 

Paste  an  image  region  to  an  annotation 
overlay 

Crop  w  Image 
Rotate  an  Image 

Rotate  to  took  angle  or  SAR  up  angle 
Flip  or  "mirror"  an  image 
Scale  arr  image 

Change  the  Aspect  Ratio  of  an  Image 

Pan/Scroll/Roam  through  an  image 

Zoom  in/out  from  a  specified  point  in  the 
image 

Manipulate  2  images  simultaneously 


Vary  contrast 
Vary  brightrress 
Vary  saturation 
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D«tect/!ntefpr«*  Object 
Detect/Interpret  Object 
Detect/tntefpret  Object 
Detect/Interpret  Object 
Detect/Interpret  Object 
Detect/Interpret  Object 
Detect/IntMpret  Object 

Detoct/lnterpret  Object 

Detect/lnterpret  Object 
Detect/tntefpret  Object 
Detoct/lnterpret  Object 
Detect/lnterpret  Object 
Detect/bUerpret  Object 
Create  Imagery  Product 
Create  bnagery  Pnxhict 
Create  Imagery  Product 
Detect/Intecpfet  Object 
Create  Imagery  Product 
Detect/Meipret  Object 
Detect/Interpret  Object 
Detect/fnterpret  CHiject 


Vary  haze 
Vary  glare 

tnvert  vkloo  (negidive) 

Convert  Imago  to  Gray  Scale/RGB 

Add  pseudo  c<rf«r  to  a  grayscale  Image 

Filter  Image  (vary  sharpness, 
smoothness,  edges) 

Eiduince  SAR  imai^  (e.g.  streak  removal) 

Enhance  Multlspectral  Imagery  (e.g., 
terrain  categorization,  atmospheric 
eorrectlonl 

Reset  from  Cundo-)  an  Enhancement 
View  image  histogram  (grayscale) 
tfiew  bnage  histogram  (RGB) 

Manipulate  image  histogram 

Match  hMogram  of  one  Image  to  another 

Create  line/shapo  objects  e.g.,  arrows, 
rectangles,  clretesl 

Draw  freehand 

Paint  or  Airbrush  an  Image 

Mark  lablong  of  a  point 

Insert  North  up  icon 

Insert  target  symbol 

insert  OB  icons 

Insert  counting  femi 


Create  Imagery  Product 
Create  Imagery  Product 
Create  Imagery  Product 
Create  Imagery  Product 
Create  Imagery  Product 
Create  bnagery  Product 
Create  bnagery  Product 
Create  bnagery  Product 
Create  Imagery  Product 
Create  bnagery  Product 
Create  Imagery  Product 
Create  bnagery  Product 
Create  Imagery  Product 
Create  bnagery  Product 


Create  new  /  edit  annotation  icons 


Add  Text/Ubel  torn  graphic 
Select  an  object 
Select  multiple  objects 
Select  all  objects 
Group  muhipla  objects 
Group  objects  in  layers 
Cut/copy/paste  an  annotation  object 
Delete  an  annotation  object 


Mk>ve  object 

Move  object  front/back  in  an  Image 
Scale  (resize)  an  Ot^t 
Rotate  an  Object 
Change  Qrai>hic's  color/style 


Create  Text  Product 
Create  Text  Product 
Create  Text  Product 
Detect/Interpret  Object 


Change  label  color/style/font 

Chartge  label  text 

Record  an  object  attribute  (text 

descriglioj^inlmdto^f^bject 

View  currarrt  cursor  coordinates 


Detoct/lnterpret  Object 


Detect/Intetpret  Object 
Detect/lnterpret  Object 
Organize  Resources 


Select  units  for  cursor  coordinates  (e.g., 
pixels,  lat/long,  UTM) 

Convert  coordinates  fora  specKied  point 
(e.g.  lat/long  to  UTM) 

View  a  coordinate  grid 

See  Overview  of  Entire  Image 
(simultMeously  with  the  working  area  of 
the  bnaoel 

Fit  entire  image  to  the  working  area  of  the 
display 


Organize  Resources 


CrMte  Jmag«y  Pfodurt 

Tiim^oW  graphics 

Gather  Relevant  Resources 

View  File  Header 

Gather  Relevant  Resources 

Dis^y  any  comments  associated  wKh  w 
image  {cotronents  that  are  not  part  of 
image  or  overlay) 

Organize  Resources 

Organize  Resources 

View  image  status/history 

View  images  side  by  side  or  top  and 
bottom  ■  - 

Detect/Interpret  Object 

Flicker  Between  Images 

Organize  Resources 

Warp  en  tntwgeto  Fft  Anotb®^ 

Detect/Interpret  Object 

Merge  (blend)  images 

Detect/btterpret  Object 

View  image  Through  Porthole 

Organize  Resources 

Stereo  Registration  and  Viewing  (stereo 
image  created  from  two  images) 

OetecVbiterpret  Object 

Measure  length/distartce 

Detect/Interpret  Object 

Measure  height 

OetectAiterprat  Object 

Measure  perimeter 

Detoct/lnterprot  Object 

Measure  area 

Deteci/Interixet  OiHeet 

Idwitify  be«rk>g 

Detect/Interpret  Object 

Geolocate  (given  a  known  coordinate, 
locate  the  point  in  an  image) 

Detect/interpret  Object 

Location  Men«jratlon(dete^  j 

coordbMtes  of  a  s^vwi  poin^ 

Detect/Interprot  Object 

Lat/Long  Correction  (adjust  lat/long  in 
image  support  data  based  on  a  known 
object/teature  location) 

Detect/Interpret  Object 

View  Curacy  Log  (with  > 

accurtcy  of  mensuration  results) 

Detect/Interpret  Object 

Count  marked  objects  in  an  image 

DetectAnterprst  Oi^ect 

AutomafUc  target  Racogrdtion 

Detect/lnterpret  Object 

Plot  Hem  (image,  installation,  etc.)  on  Map 

Detect/Interpret  Ot^ject 

Cal^ate  LatfLopg  (for  images  without 
support  data,  specify  laMoog  of  knovm  : 
objects  ^  calibrate  lat/long  data  for  ; 
enllre  image) 

Detect/lnterpret  Object 

Ground  sample  distance  calibration  (for 
images  without  support  data,  specify  the 
size  of  a  known  object  to  determine  pixel 
size  and  calibrate  tor  entire  image) 

Are  there  any  exploitation  functions  or  features  not  listed  in  this  survey  that  you  would  like  to 
see  incorporated  into  future  softcopy  exploitation  systems?  If  so,  list  them  and  briefly 
describe  how  each  one  might  work. 


Please  list  any  other  comments  on  existing  exploitation  systems  or  suggestions  on  how  to 
improve  future  exploitation  systems  below. 


This  page  left  blank  intentionally. 
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APPENDIX  E:  RESULTS  OF  UTILITY  AND  USABILITY  SURVEY 
(ELT  FEATURES  SORTED  BY  UTILITY  AND  USABILITY) 


Feature  Category 


Detect/Interpret  Object 


Detect/Interpret  Object 


Detect/Interpret  Object 


Detect/Interpret  Object 


Feature 


Geolocate  (given  a  known  coordinate,  locate  the 
point  in  an  image) 


Measure  length/distance  _ 


Pan/Scroll/Roam  through  an  image 


Zoom  in/out  from  a  specified  point  in  the  image 


Create  Imagery/Text  Product  I  Select  multiple  objects 


Create  Imagery/Text  Product  1  Select  an  object 


Detect/Interpret  Object 


Detect/Interpret  Object 


Detect/Interpret  Object 


Create  Imagery/Text  Product 


Detect/Interpret  OWect  _ 


Create  Imagerv/Text  Product 


Create  Imagery/Text  Product 


Detect/Interpret  Object 


Organize  Resources 


Detect/Interpret  Object 


Detect/Interpret  Object 


eo 

Gather  Relevant  Resources 


Organize  Resources 


Organize  Resources 


Create  Imagery/Text  Product 


Create  Imagerv/Text  Product 


Detect/bterpret  Object 


Organize  Resources 


Organize  Resources 


Gather  Relevant  Resources 


Create  Imagery/Text  Product 


Detect/Interpret  Object 


Detect/Interpret  Object 


Detect/ Interpret  Object 


Organize  Resources 


Convert  coordinates  for  a  specified  point  (e.g. 
lat/long  to  UTM)  _ 


Flicker  Between  Images 


Location  Mensuration  (determine  the  coordinates  of 
a  given  point)  _ 


Move  object 


View  current  cursor  coordinates 


Add  Text/Label  to  a  graphic 


Delete  an  annotation  object 


Identify  bearing  _ 


Insert  North  up  icon  _ 


Mark  lat/long  of  a  point  _ _ 


Measure  area  _ _ 


Measure  height  _ 


Measure  perimeter  _ 


Query  a  database  [internal  or  external]  (e.g.  search 
by  BE  #,  lat/Iong,map  region,  installation  name, 
equipment  type  etc.)  _ 


See  Overview  of  Entire  Image  (simultaneously  with 
the  working  area  of  the  image)  _ 


Warp  an  Image  to  Fit  Another 


Scale  (resize)  an  Object _ 


View  images  side  by  side  or  top  and  bottom 


Open/View  multiple  images  simultaneous! 


Create  line/shape  objects  e.g.,  arrows,  rectangles, 
circles)  _ 


Cut/Copy/Paste  (Chip)an  image  region 


Fit  entire  image  to  the  working  area  of  the  display 


Rotate  to  look  angle  or  SAR  up  angle 


Select  units  for  cursor  coordinates  (e.g.,  pixels, 
lat/long,  UTM) _ _ 


Calibrate  Lat/Long  (for  images  without  support 
data,  specify  lat/long  of  known  objects  and  calibrate 
lat/long  data  for  entire  image) 


Cut/copy/paste  an  annotation  object 


View  File  Header 


Change  label  text  _ 


Automatic  Target  Recognition 


Filter  image  (vary  sharpness,  smoothness,  edges) 


Lat/Long  Correction  (adjust  lat/long  in  image 
support  data  based  on  a  known  object/feature 
location)  _ 


Manipulate  2  images  simultaneously 


Mean  Max  Workstation 

Utility _ Usability 


CARS,  IDEX 


CDEX 


CARS,  IDEX, 
MET 


CARS,  IDEX, 
MET 


ERDAS 


VITec 


CARS 


CARS 


CARS,  IDEX, 
MET 


CARS, 

DEEPS, ERDAS, 
IDEX,  Matrix 


MET 


CARS 


CARS 


IDEX 


CARS 


CARS,  IDEX 


IDEX 


CARS,  IDEX 


CARS,  IDEX 


MET 


ERDAS 


ERDAS,  MET 


CARS,  IDEX 


CARS 


MET 


Matrix,  MET 


IDEX 


CARS 


CARS 


CARS 


ERDAS 


CARS 


IDEX,  MET 


CARS, 

ERDAS,  IDEX 


Create  Imagery/Text  Product 

Open  an  annotation  overlay  I 

4.33 

Organize  Resources 

Plot  item  (image,  installation,  etc.)  on  Map 

4.33 

Organize  Resources 

Resize  a  window 

4.33 

L^rcaic  Uiiai^ciY/  ICAL  riuuu«-i 


Detect/Interpret  Object 


Eli 


Gather  Relevant  Resources 


Create  Imagery/Text  Product 


Create  Imagery/Text  Product 


Create  Imagery/Text  Product 


Create  Imagery/Text  Product 


Detect/Interpret  Object 


Create  Imagery/Text  Product 


Gather  Relevant  Resources 


Detect/Interpret  Object 


Detect/Interpret  Object 


Disseminate  Reports 


Create  Imagery/Text  Product 


Organize  Resources 


Create  Imagery/Text  Product 


Gather  Relevant  Resources 


Detect/Interpret  Object 


Detect/Interpret  Object _ 


Detect/Interpret  Object 


Create  Imagery/Text  Product 


Create  Imagery/Text  Product 


Gather  Relevant  Resources 


Review  Taskin 


Create  Imagery/Text  Product 


Create  Imagery/Text  Product 


Create  Imagery/Text  Product 


Gather  Relevant  Resources 


Detect/Interpret  Object 


Detect/Interpret  Object 


Organize  Resources 


Organize  Resources 


Gather  Relevant  Resources 


Detect/Interpret  Object 


Create  Imagery/Text  Product 


Create  Imagery /Text  Product 


Create  Imagery/Text  Product 


Detect/Interpret  Object 


Organize  Resources 


Create  Imagery/Text  Product 


Detect/Interpret  Object  _ 


Detect/Interpret  Object 


Create  Imagery/Text  Product 


Create  Imagery/Text  Product 


Change  graphic’s  color/style _ 


Change  label  color/style/font  _ 


Select  all  objects  _ _ _ 


Scale  an  Image  _ 


Export  (save)  a  file  to  an  external  database _ 


Receive  an  NITF  file  (COMM  function) _ 


Reset  from  (‘undo’)  an  Enhancement _ 


Rotate  an  Image  _ 


Print  a  file  _ _ 


Transmit  an  NITF  file  (COMM  function) _ 


Create  new  /  edit  annotation  icons _ 


Ground  sample  distance  calibration  (for  images 
without  support  data,  specify  the  size  of  a  known 
object  to  determine  pixel  size  and  calibrate  for 
entire  image)  _ _ _ 


Group  multiple  objects _ 


Save  a  file  in  a  different  file  format _ 


Import  a  file  from  an  external  database _ 


View  Accuracy  Log  (with  estimated  accuracy  of 
mensuration  results)  _ _ _ 


Enhance  SAR  image  (e.g.  streak  removal) _ 


Count  marked  objects  in  an  image _ 


Create  a  mosaic  _ _  -- 


Crop  an  Image 


Move  object  front/back  in  an  image _ 


Display  any  comments  associated  with  an  image 
(comments  that  are  not  part  of  image  or  overlay) 


Open  a  text  file  _ 


Draw  freehand  _ _ 

Paste  an  image  region  to  an  annotation  overlay 


‘Bum  In’  Overlays  (imbed  overlay  in  image) 


Cascade  Multiple  Windows  _ _ 


Open  a  reference  map  for  an  image _ 

haze  _ 


Vary  saturation  _ 


Arrange  Icons  or  Toolbars  _ _ 


Specify  image  distribution  _ 


Filter  a  list  of  files  in  a  directory  (i.e.,  list  only  files 
with  a  given  character  string  in  the  filename  or 
extension) _ _ 


Convert  Image  to  Gray  Scale/RGB _ 


Edit  File  Header  _ 


Group  objects  in  layers  _ 


Link/associate  support  files  to  an  image,  object 
category,  OB,  etc.)  _ 


Tile  Multiple  Windows  _ 


View  a  coordinate  grid 


View  image  status/history  _ 


Print  entire  screen  _ _ 


Vary  glare  _ 


Enhance  Multispectral  Imagery  (e.g.,  terrain 
categorization,  atmospheric  correction) _ 


Autorecord  Data  (e.g.  mensuration  data)  to  the 
Notepad  _ 


Digitize  an  image  (from  external  device  e.g., 
scanner.) 


IDEX,  MET 


IDEX,  MET 


CARS 


ERDAS 


ERDAS 


ERDAS 


VlTec 


DIEPS,  Matrix 


CARS 


Matrix 


IDEX 


CARS,  IDEX 


CARS 


ERDAS 


CARS 


ERDAS, 
Matrix,  VITec 


ERDAS 


ERDAS 


VITec 


VITec 


ERDAS,  Matrix 


IDEX 


MET 


DIEPS,  Matrix, 
VITec 


ERDAS 


VITec 


CARS 


ERDAS 


VITec 


ERDAS,  IDEX 


ERDAS,  MET 


ERDAS 


IDEX 


IDEX 


CARS 


CARS 


ERDAS 


VITec 


Matrix 


ERDAS 


CARS,  ERDAS 


ERDAS,  MET 


ERDAS, 
Matrix,  MET 


VITec 


CARS 


CARS 


ERDAS 


ERDAS,  Matrix 


ERDAS,  IDEX 


Detect/Interpret  Object 

Insert  target  symbol 

4.00 

ERDAS,  IDEX 

Detect/Interpret  Object 

Insert  OB  icons 

3.33 

5,00 

IDEX 

Detect/Interpret  Object 

Stereo  Registration  and  Viewing  (stereo  image 
created  from  two  images) 

3.33 

5.00 

IDEX 

Gather  Relevant  Resources 

Load  multi  spectral  imagery 

3.33 

4.00 

ERDAS 

Create  Imagery/Text  Product 

Record  an  object  attribute  (text  description  linked  to 
an  object) 

3.33 

4.00 

Insert  counting  icon 

3.17 

5.00 

IDEX 

Detect/Interpret  Object 

Invert  video  (negative) 

3.17 

4.00 

IDEX 

Create  Imagery/Text  Product 

Open  a  notepad 

3.17 

4.00 

Matrix 

Detect/Interpret  Object 

Flip  or  ‘mirror’  an  image 

5.00 

Organize  Resources 

Change  the  Aspect  Ratio  of  an  Image 

3.00 

3.00 

View  Image  Through  Porthole 

3.00 

2.00 

Detect/Interpret  Object 

Manipulate  image  histogram 

2.83 

5.00 

Create  Imagery/Text  Product 

Paint  or  Airbrush  an  Image 

2.83 

4.17 

VITec 

Detect/Interpret  Object 

Add  pseudo  color  to  a  grayscale  image  ! 

2.83 

4.00 

ERDAS 

Detect/Interpret  Object 

View  image  histogram  (grayscale) 

2.83 

4.00 

ERDAS 

Detect/Interpret  Object 

View  image  histogram  (RGB) 

2.83 

4.00 

ERDAS 

Detect/Interpret  Object 

Match  histogram  of  one  Image  to  another 

2.67 

MET 

Gather  Relevant  Resources 

Access  a  personal  folder  of  lA  support  tools 

2.67 

4.00 

ERDAS 
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APPENDIX  F:  IMAGERY  ANALYST  WORKSTATION  INTERFACE 
REQUIREMENTS  SPECIFICATION 

INTRODUCTION 

This  document  describes  the  user  interface  requirements  for  an  ELT  system  designed  to  support  the 
Air  Force  intelligence  mission  through  quick  and  effective  imagery  exploitation.  The  purpose  of  this 
system  is  to  provide  the  Air  Force  imagery  /  intelligence  analyst  with  the  most  effective  toolset  for 
the  exploitation  of  all  types  of  digital  imagery. 

Any  user  interface  for  an  ELT  system  created  to  support  the  imagery  exploitation  mission  should 
effectively  support  the  three  main  areas  of  imagery  exploitation,  Orientation,  Information  Extraction, 
and  Reporting.  Orientation  refers  to  the  process  by  which  the  lA  understands  the  problem  or  the 
questions  that  are  being  asked.  It  also  includes  understanding  the  capabilities  and  the  limitations  of 
the  imagery  for  answering  those  questions.  Information  Extraction  refers  to  the  process  of  finding 
objects  in  and  coming  to  conclusions  about  the  imagery,  consistent  with  the  lA’s  tasking.  Reporting 
refers  to  the  process  of  compiling  and  disseminating  conclusions  drawn  from  the  imagery  in  response 
to  the  tasking. 

Based  on  the  results  of  the  Imagery  /  Intelligence  Analyst  Workstation  Interface  Analysis  (to  which 
this  document  is  an  appendix),  a  set  of  interface  requirements  was  constructed. 

GENERAL  DESCRIPTION 

Assuming  that  this  ELT  system  would  be  implemented  in  a  UNIX-based  operating  system 
environment,  the  overall  style  and  ‘look  and  feel’  of  the  user  interface  should  conform  to  the  Motif 
style  of  X-Windows  user  interface  wherever  practical  and  appropriate. 

The  user  interface  should  also  offer  as  much  flexibility  in  the  creation,  storage,  and  recall  of 
individual  user  configurations.  For  example,  if  toolbars  will  be  used  for  implementing  quick  access 
to  frequently  used  features,  the  interface  should  allow  a  user  to  easily  create  and  store  sets  of  features 
that  can  be  assigned  to  a  toolbar  or  toolbars.  These  feature  sets  should  be  easy  to  recall,  either  in  the 
form  of  ‘pull-down’  or  ‘drop-down’  lists  from  which  a  set  could  be  selected  ~  or  even  linked  to  a 
user’s  login  act  (e.g.,  in  the  case  of  a  default  configuration  for  a  particular  user,  the  system 
implements  this  configuration  upon  user  login  to  the  system  without  necessarily  prompting  the  user.) 
This  flexibility  in  configuration  should  be  inherent  at  multiple  levels.  For  example,  the  interface 
should  allow  a  user  to  create  higher  level  configurations  based  on  multiple  toolbar  sets  -  not  simply 
feature  sets  assigned  to  particular  toolbars. 

The  user  interface  should  allow  a  user  to  assign  contextual  functionality  to  different  controls  as 
practical.  For  example,  when  using  a  zoom  feature  the  user  should  be  able  to  assign  directionality  of 
the  zoom  to  different  mouse  buttons  (e.g.,  ‘zoom-in’  with  the  left  button  and  ‘zoom-out’  with  the 
right,  or  vice  versa).  This  functionality  would  only  be  available,  however,  while  using  the  zoom 
feature  unless  otherwise  specified  by  the  user. 

Because  the  user  frequently  shifts  goal  states  (i.e.,  from  orientation  to  information  extraction  to 
reporting,  etc.),  the  interface  should  be  designed  so  that  these  task  shifts  are  accommodated  as 
seamlessly  as  possible.  In  accordance  with  this  philosophy,  the  interface  should  provide  the  user  the 
capability  to  ‘undo’  and  ‘redo’  as  many  operations  as  necessary.  The  user  should  also  be  provided 
with  a  historical  display  of  the  operations  enacted  and  /  or  retracted  and  the  ability  to  interact  with 
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this  display  to  command  additional  operations  or  groups  of  operations  to  be  perfomed.  For  examp  e, 
the  system  should  keep  a  record  of  all  user  commanded  operations.  The  user  would  have  the 
capability  to  call  up  this  record  on  a  window  separate  from  other  working  windows  and  then  be  ab  e 
to  select  operations  or  sequences  of  operations  from  the  record  and  apply  those  operations  or 
operation  sequences  to  any  or  all  open  images.  The  user  should  also  have  the  capability  to  save  these 
operations  /  operation  sequences  or  groups  of  operations  /  operation  sequences  as  individual  entities 

so  that  the  user  has  easy  access  to  them. 

The  interface  requirements  specified  in  this  document  are  referred  to  as  interface and  are 
organized  by  the  exploitation  process  they  tend  to  support  most.  Features  that  may  support  multiple 
processes  will  be  listed  only  once. 


SPECIFIC  FEATURE  REQUIREMENTS 


Orientation  Features 

1.1.  The  user  interface  shall  provide  the  capability  to  display  any  comments  associated  with  an 
image  (comments  that  are  not  part  of  image  or  overlay)  and  to  edit  those  comments. 

1 .2.  The  user  interface  shall  provide  the  capability  to  filter  a  list  of  files  in  a  directory  (i.e.,  list  only 
files  with  a  given  character  string  in  the  filename  or  extension.) 

1 .3.  The  user  interface  shall  provide  the  capability  to  identify  images  /  reports  associated  with  a 
given  image. 

1  4  The  user  interface  shall  provide  the  capability  to  import  a  file  from  an  external  database.  The 
types  of  files  available  for  import  shall  include  NITF  2.X  and  1  .X,  all  widely  used  commercial 
image  formats  such  as  GIF,  JPEG,  TIFF,  etc.,  all  commercial  and  propnetary  raster  formats 
currently  used  by  any  DOD  imagery  exploitation  organization,  and  ASCII  text.  Other  text 
formats  such  as  FrameMaker  may  be  considered  depending  on  their  usage  among  the 
exploitation  community. 

1  5  The  user  interface  shall  provide  the  capability  to  load,  open,  and  edit  multispectral  imagei7. 

This  feature  should  also  include  the  ability  to  selectively  include  or  exclude  any  spectral  bands 
and  to  code  each  band  as  a  particular  user-selected  or  default  color. 

1 .6.  The  user  interface  shall  provide  the  capability  to  open  a  reference  map  for  an  image^Based  on 
image  coordinates  inherent  in  the  image  file  or  on  user-entered  coordinates,  the  interface  shall 
provide  an  outline  and  /  or  a  reduced  size  /  resolution  version  of  the  image  supenmposed  on  an 
‘oil  stock’  map  image  (if  available)  or  vector  drawn  map  in  the  appropriate  location.  An 
indication  of  location  accuracy  shall  also  be  displayed. 

1 .7.  The  user  interface  shall  provide  the  capability  to  query  any  available  local  or  distributed 
database  for  reference  text  or  image  files  relevant  to  the  exploitation  of  mission  imagery.  This 
feature  shall  include  the  ability  to  search  by  various  file  associated  data  such  as, 

Encyclopedia  (BE)  number,  latitude  /  longitude,  installation  name,  equipment  type,  OB, 
keyword  in  a  text  report,  or  any  other  relevant  identifier,  by  spatial  information  such  as 
specifying  a  region  on  a  spatial  query  map,  by  temporal  information  such  as  specifying  a 
particular  time  frame  of  interest,  or  any  combination  of  these  methods. 
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1 .8.  The  user  interface  shall  provide  the  capability  to  receive  NITF  2.X  and  l.X  files.  This  feature 
shall  include  the  capability  to  immediately  display  any  or  all  images  as  they  are  received  or  to 
defer  display  of  images  to  a  user-specified  time  and  /  or  order. 

1 .9.  The  user  interface  shall  provide  the  capability  to  view  and  edit  file  header  and  /  or  image 
header  information.  This  feature  shall  also  provide  the  capability  to  easily  and  intuitively 
associate  these  data  with  their  respective  files  and  /  or  images. 

1.10.  The  user  interface  shall  provide  the  capability  to  calibrate  latitude  /  longitude  (for  images 
without  support  data,  specify  latitude  /  longitude  of  known  objects  and  calibrate  latitude  / 
longitude  data  for  entire  image).  The  user  will  be  able  to  select  single  points  in  an  image  and 
provide  latitude  and  longitude  values  for  these  points.  The  system  shall  then  interpolate  and 
extrapolate  the  coordinates  of  the  remaining  points. 

1.11.  The  user  interface  shall  provide  the  capability  to  cascade  and  /  or  tile  multiple  windows 
according  to  the  user’s  preference. 

1.12.  The  user  interface  shall  provide  the  capability  to  change  the  aspect  ratio  of  an  image.  This 
feature  shall  be  implemented  by  allowing  the  user  to  either  indirectly  change  the  ratio  through 
the  manual  definition  of  a  new  aspect  ratio  (in  a  user-requested  pop-up  data  entry  box)  or 
through  direct  manipulation  by  using  the  mouse  /  pointing  device  to  grab  a  comer  or  edge  of 
the  image  and  drag  it.  The  first  method  will  require  the  display  of  the  aspect  ratio  statically 
while  the  second  method  will  require  the  display  of  the  aspect  ratio  dynamically,  or  as  it  is 
changes  while  dragging  an  image  edge  or  comer. 

1.13.  The  user  interface  shall  provide  the  capability  to  create  a  mosaic  of  multiple  images.  The 
mosaic  should  be  able  to  be  built  either  by  manually  tiling  images  next  to  each  other  or 
automatically  by  user’s  request.  The  automatic  mosaic  capability  shall  be  driven  by  the 
availability  of  image  coordinates  in  comparable  or  convertible  geo-location  coordinate 
systems.  All  open  images  that  are  being  selected  for  automatic  mosaicing  that  meet  the 
previous  geo-location  coordinates  requirements  will  be  ‘stitched’  together  in  relative  position 
to  one  another. 

1.13.1  This  feature  shall  also  include  the  capability  to  geo-locate  the  mosaic  unit  on  an 
electronic  ‘oil  stock’  map,  if  available,  or  on  the  appropriate  vector-drawn  map. 

1.13.2  This  feature  shall  also  include  the  capability  to  save  mosaics  as  image  files  or  as 
associative  units.  That  is,  the  user  shall  have  the  capability  to  name  and  save  for  future 
reference  a  mosaic  as  a  new  image  (in  any  appropriate  format),  or  as  an  association 
(much  like  an  alias)  between  the  composite  images  in  the  mosaic.  This  will  allow  the 
user  to  quickly  and  easily  retrieve  the  mosaic  while  saving  storage  space,  if  necessary. 

1.14.  The  user  interface  shall  provide  the  capability  to  fit  an  entire  image  to  the  working  area  of  the 
display.  That  is,  an  image,  no  matter  the  actual  size  and  /  or  resolution  shall  be  able  to  be 
opened  so  that  the  entire  image  completely  fills  the  available  viewing  area  of  the  display  m  the 
limit  of  the  image’s  size.  If  an  image  at  full  resolution  is  physically  smaller  than  the  maximum 
viewing  area,  the  image  shall  be  opened  at  its  maximum  resolution. 

1.15.  The  user  interface  shall  provide  the  capability  to  perform  ground  sample  distance  calibration. 
That  is,  for  images  without  support  data,  the  user  shall  be  able  to  specify  the  size  of  a  known 
object  in  the  image  to  determine  pixel  size  and  calibrate  the  entire  image.  This  feature  shall 
also  provide  the  user  an  indication  of  the  mensuration  uncertainty  introduced  by  this  procedure 
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and  the  total  estimated  uncertainty  in  mensuration  due  to  the  combination  of  this  procedure 
with  all  other  known  sources  of  error. 

1.16.  The  user  interface  shall  provide  the  capability  to  quickly  and  easily  insert  a  north-up  icon  into 
an  image.  It  is  expected  that  orientation  of  the  north-up  icon  will  be  automatic  where  geo¬ 
location  coordinates  are  known  (e.g.,  NITF  format).  This  feature  will  alert  the  user  when 
coordinates  are  not  known  that  orientation  must  be  performed  manually,  and  will  indicate 
where  manual  orientation  is  performed. 

1.17.  The  user  interface  shall  provide  the  capability  to  manipulate  two  images  simultaneously 

1.18.  The  user  interface  shall  provide  the  capability  to  open  /  view  multiple  images  simultaneously 

1.19.  The  user  interface  shall  provide  the  capability  to  plot  an  object  (image,  installation,  etc.)  on  an 
electronic  ‘oil  stock’,  if  available,  or  a  vector-drawn  map.  This  feature  will  be  available  to  the 
user  when  geo-location  coordinates  for  the  image  and  /  or  objects  within  the  image  are  known. 

1 .20.  The  user  interface  shall  provide  the  capability  to  resize  a  window  by  using  the  mouse  / 
pointing  device  to  select  the  window  and  to  grab  an  edge  or  comer  of  the  window  and  drag  it 
to  it’s  new  location.  More  or  less  of  the  image  in  the  window  will  then  be  in  view  depending 
on  whether  the  edge  or  comer’s  new  location  is  farther  from  or  closer  to  the  origin  of  the 
window,  respectively. 

1.21.  The  user  interface  shall  provide  the  capability  to  see  an  overview  thumbnail  (a  smaller, 
reduced  resolution  version  of  an  image)  simultaneously  with  the  working  area  of  the  image. 
This  feature  shall  be  active  when  the  current  image  cannot  be  entirely  viewed  in  the  working 
area  of  the  image  display  because  the  working  area  of  the  image  display  is  being  shown  at  a 
higher  zoom  level  than  100%.  An  indication  of  how  much  of  the  entire  image  the  current 
working  area  of  the  display  represents  shall  be  required.  An  example  of  how  this  might  be 
done  is  to  provide  a  rectangular  outline  on  the  overview  thumbnail  that  corresponds  to  what  is 
currently  being  displayed  in  the  image  working  area. 

1  22  The  user  interface  shall  provide  the  capability  to  select  units  for  cursor  coordinates,  such  as 

pixels,  latitude /longitude,  and  UTM.  This  shall  require  that  the  system  be  able  to  convert 

between  coordinate  systems  at  any  time. 

1 .23.  The  user  interface  shall  provide  the  capability  to  quickly  and  easily  specify  image  distribution. 
That  is,  while  the  user  is  performing  image-screening  activities,  the  user  shall  have  the 
capability  to  ‘chip’  out  a  sub-image  of  user-predefined  size  and  transmit  the  chip  into  a 
predefined  exploitation  queue. 

1 .24.  The  user  interface  shall  provide  the  capability  to  view  image  status  /  history 

1.25.  The  user  interface  shall  provide  the  capability  to  view  images  side  by  side  and  /  or  top  and 
bottom.  That  is,  for  any  two  images  that  are  being  compared,  the  user  shall  be  able  to  quickly 
and  to  easily  specify  whether  images  for  comparison  will  be  displayed  horizontally  or 
vertically. 

1.26.  The  user  interface  shall  provide  the  capability  to  warp  an  image  to  fit  another.  That  is,  the 
user  will  have  the  capability  to  specify  points  /  pixels  through  direct  manipulation  on  one 
image  that  correspond  to  the  same  number  of  points  /  pixels  on  another  image.  The  system 
wilUhen  re-dimension  the  first  image  so  that  these  points  of  correspondence  match. 
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1 21.  The  user  interface  shall  provide  the  capability  to  open,  edit,  and  save  a  text  file.  The  editing 
functions  shall  include  the  ability  to  cut,  copy,  and  /  or  paste  text  through  menu  selections  or 
keyboard  shortcuts. 

Information  Extraction 

2. 1 .  The  user  interface  shall  provide  the  capability  to  apply  pseudo  color  to  a  grayscale  image. 

2.2.  The  user  interface  shall  provide  automatic  target  recognition  capability. 

2.3.  The  user  interface  shall  provide  the  capability  to  convert  coordinates  for  a  specified  point  (e.g. 
latitude  /  longitude  to  UTM). 

2.4.  The  user  interface  shall  provide  the  capability  to  convert  image  to  grayscale  /  RGB. 

2.5.  The  user  interface  shall  provide  the  capability  to  count  marked  objects  in  an  image. 

2.6.  The  user  interface  shall  provide  the  capability  to  enhance  multispectral  imagery  (e.g.,  terrain 
categorization  and  atmospheric  correction). 

2.7.  The  user  interface  shall  provide  the  capability  to  enhance  SAR  imagery  (e.g.  streak  removal). 

2.8.  The  user  interface  shall  provide  the  capability  to  filter  imagery  (vary  sharpness,  smoothness, 
edges). 

2.9.  The  user  interface  shall  provide  the  capability  to  flicker  between  images. 

2.10.  The  user  interface  shall  provide  the  capability  to  flip  or  ‘mirror’  an  image. 

2.1 1 .  The  user  interface  shall  provide  the  capability  to  geo-locate  (given  a  known  coordinate,  locate 
the  point  in  an  image). 

2.12.  The  user  interface  shall  provide  the  capability  to  identify  bearing. 

2.13.  The  user  interface  shall  provide  the  capability  to  insert  counting  icons. 

2.14.  The  user  interface  shall  provide  the  capability  to  insert  OB  icons. 

2.15.  The  user  interface  shall  provide  the  capability  to  insert  target  symbols. 

2.16.  The  user  interface  shall  provide  the  capability  to  invert  video  (negative). 

2.17.  The  user  interface  shall  provide  the  capability  to  correct  latitude  /  longitude  (adjust  latitude  / 
longitude  in  image  support  data  based  on  a  known  object  /  feature  location). 

2.18.  The  user  interface  shall  provide  location  mensuration  (determine  the  coordinates  of  a  given 
point)  capability. 

2.19.  The  user  interface  shall  provide  the  capability  to  manipulate  image  histograms. 

2.20.  The  user  interface  shall  provide  the  capability  to  mark  latitude  /  longitude  of  a  point. 

2.21 .  The  user  interface  shall  provide  the  capability  to  match  the  histogram  of  one  image  to  another. 

2.22.  The  user  interface  shall  provide  the  capability  to  measure  area. 
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2.23.  The  user  interface  shall  provide  the  capability  to  measure  height. 

2.24.  The  user  interface  shall  provide  the  capability  to  measure  length  /  distance. 

2.25.  The  user  interface  shall  provide  the  capability  to  measure  perimeter. 

2.26.  The  user  interface  shall  provide  the  capability  to  merge  (blend)  images. 

2.27.  The  user  interface  shall  provide  the  capability  to  pan  /  scroll  /  roam  through  an  image. 

2.28.  The  user  interface  shall  provide  the  capability  to  reset  from  (‘undo’)  an  enhancement. 

2.29.  The  user  interface  shall  provide  the  capability  to  rotate  an  image. 

2.30.  The  user  interface  shall  provide  the  capability  to  rotate  to  look  angle  or  SAR  up  angle. 

2.3 1 .  The  user  interface  shall  provide  the  capability  to  scale  an  image. 

2.32.  The  user  interface  shall  provide  the  capability  for  stereo  registration  and  viewing  (stereo  image 
created  from  two  images). 

2.33.  The  user  interface  shall  provide  the  capability  to  vary  brightness. 

2.34.  The  user  interface  shall  provide  the  capability  to  vary  contrast. 

2.35.  The  user  interface  shall  provide  the  capability  to  vary  glare. 

2.36.  The  user  interface  shall  provide  the  capability  to  vary  haze. 

2.37.  The  user  interface  shall  provide  the  capability  to  vary  saturation. 

2.38.  The  user  interface  shall  provide  the  capability  to  view  a  coordinate  grid. 

2.39.  The  user  interface  shall  provide  the  capability  to  view  an  accuracy  log  (with  estimated 
accuracy  of  mensuration  results). 

2.40.  The  user  interface  shall  provide  the  capability  to  view  current  cursor  coordinates. 

2.41.  The  user  interface  shall  provide  the  capability  to  view  image  histograms  (grayscale). 

2.42.  The  user  interface  shall  provide  the  capability  to  view  image  histograms  (RGB). 

2.43.  The  user  interface  shall  provide  the  capability  to  view  an  image  through  a  porthole. 

2  44  'pjje  user  interface  shall  provide  the  capability  to  zoom  in  /  out  from  a  specified  point  in  the 
image. 

Reporting 

3.1 .  The  user  interface  shall  provide  the  capability  to  ‘Bum  In’  Overlays  (imbed  an  overlay  in 
image). 

3.2.  The  user  interface  shall  provide  the  capability  to  add  text  /  label  to  a  graphic. 

3.3.  The  user  interface  shall  provide  the  capability  to  auto-record  data  (e.g.,  mensuration  data)  to 
the  Notepad. 
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3.4.  The  user  interface  shall  provide  the  capability  to  change  a  graphic’s  color  /  style. 

3.5.  The  user  interface  shall  provide  the  capability  to  change  label  color  /  style  /  font. 

3.6.  The  user  interface  shall  provide  the  capability  to  change  label  text. 

3.7.  The  user  interface  shall  provide  the  capability  to  create  line  /  shape  objects  (e.g.,  arrows, 
rectangles,  and  circles). 

3.8.  The  user  interface  shall  provide  the  capability  to  create  new  /  edit  annotation  icons. 

3.9.  The  user  interface  shall  provide  the  capability  to  crop  an  image. 

3.10.  The  user  interface  shall  provide  the  capability  to  cut  /  copy  /  paste  (chip)  an  image  region. 

3.1 1.  The  user  interface  shall  provide  the  capability  to  cut  /  copy  /  paste  an  annotation  object. 

3.12.  The  user  interface  shall  provide  the  capability  to  delete  an  annotation  object. 

3.13.  The  user  interface  shall  provide  the  capability  to  digitize  an  image  using  an  external  device 
(e.g.,  scanner). 

3. 14.  The  user  interface  shall  provide  the  capability  to  draw  freehand. 

3.15.  The  user  interface  shall  provide  the  capability  to  edit  file  headers. 

3.16.  The  user  interface  shall  provide  the  capability  to  export  (save)  a  file  to  an  external  database. 

3.17.  The  user  interface  shall  provide  the  capability  to  group  objects  in  layers. 

3.18.  The  user  interface  shall  provide  the  capability  to  group  multiple  objects. 

3.19.  The  user  interface  shall  provide  the  capability  to  link  /  associate  support  files  to  an  image 
(object  category,  OB,  etc.). 

3.20.  The  user  interface  shall  provide  the  capability  to  move  an  object. 

3.21 .  The  user  interface  shall  provide  the  capability  to  move  an  object  forward  /  backward  in  an 
image. 

3.22.  The  user  interface  shall  provide  the  capability  to  open  a  notepad. 

3.23.  The  user  interface  shall  provide  the  capability  to  open  an  annotation  overlay. 

3.24.  The  user  interface  shall  provide  the  capability  to  paint  or  airbrush  an  image. 

3.25.  The  user  interface  shall  provide  the  capability  to  paste  an  image  region  to  an  annotation 
overlay. 

3.26.  The  user  interface  shall  provide  the  capability  to  print  a  file. 

3.27.  The  user  interface  shall  provide  the  capability  to  print  the  entire  screen. 

3.28.  The  user  interface  shall  provide  the  capability  to  record  an  object  attribute  (i.e.,  text 
description  linked  to  an  object). 

3.29.  The  user  interface  shall  provide  the  capability  to  rotate  an  object. 
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3.30.  The  user  interface  shall  provide  the  capability  to  save  a  file  in  a  different  file  format. 

3.31 .  The  user  interface  shall  provide  the  capability  to  scale  (resize)  an  object. 

3.32.  The  user  interface  shall  provide  the  capability  to  select  all  objects. 

3.33.  The  user  interface  shall  provide  the  capability  to  select  an  object. 

3.34.  The  user  interface  shall  provide  the  capability  to  select  multiple  objects. 

3.35.  The  user  interface  shall  provide  the  capability  to  toggle  on  /  off  graphics. 

3.36.  The  user  interface  shall  provide  the  capability  to  transmit  an  NITF  file. 
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